2024-05-25T04:58:56.187 INFO:root:teuthology version: 0.0.1.dev291+ge7ae758 2024-05-25T04:58:56.188 DEBUG:teuthology.run:Teuthology command: teuthology --archive /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291 --owner scheduled_teuthology@teuthology --verbose --description orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} --name teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi -- /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291/orig.config.yaml 2024-05-25T04:58:56.236 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-25T04:58:56.323 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291 branch: squid description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} email: ceph-qa@ceph.com first_in_suite: false job_id: '7725291' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi no_nested_subset: false os_type: centos os_version: 9.stream overrides: admin_socket: branch: squid ceph: conf: global: mon election default strategy: 3 mgr: debug mgr: 20 debug ms: 1 mgr/cephadm/use_agent: true mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: debug ms: 1 debug osd: 20 flavor: default log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) log-only-match: - CEPHADM_ sha1: ea0684c08cbcf83f4af9930de2267b3563ac5f78 ceph-deploy: conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} install: ceph: flavor: default sha1: ea0684c08cbcf83f4af9930de2267b3563ac5f78 workunit: branch: squid sha1: 17c123e524b17eb0cf38bdb0a0ca89d80b36c131 owner: scheduled_teuthology@teuthology priority: 100 repo: https://git.ceph.com/ceph.git roles: - - mon.a - mon.c - mgr.y - osd.0 - osd.1 - osd.2 - osd.3 - client.0 - node-exporter.a - alertmanager.a - - mon.b - mgr.x - osd.4 - osd.5 - osd.6 - osd.7 - client.1 - prometheus.a - grafana.a - node-exporter.b seed: 4121 sha1: ea0684c08cbcf83f4af9930de2267b3563ac5f78 sleep_before_teardown: 0 subset: 40/64 suite: orch suite_branch: squid suite_path: /home/teuthworker/src/git.ceph.com_ceph_17c123e524b17eb0cf38bdb0a0ca89d80b36c131/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph.git suite_sha1: 17c123e524b17eb0cf38bdb0a0ca89d80b36c131 targets: smithi088.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmAPsD46q7noVBJOSW/pJjB3KUxWaa8KgHEhuPlfmpWFjnoEHemRMYfvZ55nFPJwi1jeWDIVJZ1MDM+nIkagsw= smithi136.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGR8R/fTWmHDUs4yQnSE7d9f09XfE5qF5LRIGf4RZV9psRG4yqvYi5epDrUDzuQfd7syNd7Kl+ZI2u3x1MAnTQ0= tasks: - cephadm: cephadm_branch: v17.2.0 cephadm_git_url: https://github.com/ceph/ceph image: quay.io/ceph/ceph:v17.2.0 - cephadm.shell: env: - sha1 mon.a: - radosgw-admin realm create --rgw-realm=r --default - radosgw-admin zonegroup create --rgw-zonegroup=default --master --default - radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default - radosgw-admin period update --rgw-realm=r --commit - ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000 - ceph osd pool create foo - rbd pool init foo - ceph orch apply iscsi foo u p - sleep 180 - ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force - ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force - ceph config set global log_to_journald false --force - ceph orch ps - ceph versions - ceph -s - ceph orch ls - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph health detail - ceph versions | jq -e '.mgr | length == 2' - ceph mgr fail - sleep 180 - ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1 - ceph orch ps --refresh - sleep 180 - ceph orch ps - ceph versions - ceph health detail - ceph -s - ceph mgr fail - sleep 180 - ceph orch ps - ceph versions - ceph -s - ceph health detail - ceph versions | jq -e '.mgr | length == 1' - ceph mgr fail - sleep 180 - ceph orch ps - ceph orch ls - ceph versions - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph versions | jq -e '.mgr | length == 1' - ceph versions | jq -e '.mgr | keys' | grep $sha1 - ceph versions | jq -e '.overall | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 2' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 2' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '{print $2}') - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.mon | length == 1' - ceph versions | jq -e '.mon | keys' | grep $sha1 - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 5' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 7' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd --limit 1 - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 2' - ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '.up_to_date | length == 8' - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types crash,osd - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.osd | length == 1' - ceph versions | jq -e '.osd | keys' | grep $sha1 - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --services rgw.foo - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done - ceph orch ps - ceph versions | jq -e '.rgw | length == 1' - ceph versions | jq -e '.rgw | keys' | grep $sha1 - ceph orch upgrade status - ceph health detail - ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 - cephadm.shell: env: - sha1 mon.a: - while ceph orch upgrade status | jq '.in_progress' | grep true && ! ceph orch upgrade status | jq '.message' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; ceph health detail ; sleep 30 ; done - ceph orch ps - ceph versions - echo "wait for servicemap items w/ changing names to refresh" - sleep 60 - ceph orch ps - ceph versions - ceph orch upgrade status - ceph health detail - ceph versions | jq -e '.overall | length == 1' - ceph versions | jq -e '.overall | keys' | grep $sha1 - ceph orch ls | grep '^osd ' - cephadm.shell: mon.a: - ceph orch upgrade ls - ceph orch upgrade ls --image quay.io/ceph/ceph --show-all-versions | grep 16.2.0 - ceph orch upgrade ls --image quay.io/ceph/ceph --tags | grep v16.2.2 teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: e7ae7580c417d6ab27fda98fecadca5d9f85d63e timestamp: 2024-05-24_21:08:02 tube: smithi user: teuthology verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.2698841 2024-05-25T04:58:56.324 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph_17c123e524b17eb0cf38bdb0a0ca89d80b36c131/qa; will attempt to use it 2024-05-25T04:58:56.324 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph_17c123e524b17eb0cf38bdb0a0ca89d80b36c131/qa/tasks 2024-05-25T04:58:56.325 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-05-25T04:58:56.326 INFO:teuthology.task.internal:Checking packages... 2024-05-25T04:58:56.348 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash 'ea0684c08cbcf83f4af9930de2267b3563ac5f78' 2024-05-25T04:58:56.348 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-05-25T04:58:56.348 INFO:teuthology.packaging:ref: None 2024-05-25T04:58:56.348 INFO:teuthology.packaging:tag: None 2024-05-25T04:58:56.348 INFO:teuthology.packaging:branch: squid 2024-05-25T04:58:56.348 INFO:teuthology.packaging:sha1: ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T04:58:56.348 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=squid 2024-05-25T04:58:56.614 INFO:teuthology.task.internal:Found packages for ceph version 19.0.0-2847.g17c123e5 2024-05-25T04:58:56.615 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-05-25T04:58:56.622 INFO:teuthology.task.internal:no buildpackages task found 2024-05-25T04:58:56.622 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-05-25T04:58:56.718 INFO:teuthology.task.internal:Saving configuration 2024-05-25T04:58:56.737 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-05-25T04:58:56.747 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-05-25T04:58:56.772 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi088.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-25 04:53:29.503756', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBBmAPsD46q7noVBJOSW/pJjB3KUxWaa8KgHEhuPlfmpWFjnoEHemRMYfvZ55nFPJwi1jeWDIVJZ1MDM+nIkagsw='} 2024-05-25T04:58:56.798 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi136.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-05-25 04:53:29.502002', 'locked_by': 'scheduled_teuthology@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBGR8R/fTWmHDUs4yQnSE7d9f09XfE5qF5LRIGf4RZV9psRG4yqvYi5epDrUDzuQfd7syNd7Kl+ZI2u3x1MAnTQ0='} 2024-05-25T04:58:56.798 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-05-25T04:58:56.805 INFO:teuthology.task.internal:roles: ubuntu@smithi088.front.sepia.ceph.com - ['mon.a', 'mon.c', 'mgr.y', 'osd.0', 'osd.1', 'osd.2', 'osd.3', 'client.0', 'node-exporter.a', 'alertmanager.a'] 2024-05-25T04:58:56.805 INFO:teuthology.task.internal:roles: ubuntu@smithi136.front.sepia.ceph.com - ['mon.b', 'mgr.x', 'osd.4', 'osd.5', 'osd.6', 'osd.7', 'client.1', 'prometheus.a', 'grafana.a', 'node-exporter.b'] 2024-05-25T04:58:56.805 INFO:teuthology.run_tasks:Running task console_log... 2024-05-25T04:58:56.870 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7f945e027ac0>, signals=[15]) 2024-05-25T04:58:56.870 INFO:teuthology.run_tasks:Running task internal.connect... 2024-05-25T04:58:56.878 INFO:teuthology.task.internal:Opening connections... 2024-05-25T04:58:56.879 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi088.front.sepia.ceph.com 2024-05-25T04:58:56.881 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T04:58:56.961 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi136.front.sepia.ceph.com 2024-05-25T04:58:56.961 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T04:58:57.039 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-05-25T04:58:57.046 DEBUG:teuthology.orchestra.run.smithi088:> uname -m 2024-05-25T04:58:57.064 INFO:teuthology.orchestra.run.smithi088.stdout:x86_64 2024-05-25T04:58:57.064 DEBUG:teuthology.orchestra.run.smithi088:> cat /etc/os-release 2024-05-25T04:58:57.121 INFO:teuthology.orchestra.run.smithi088.stdout:NAME="CentOS Stream" 2024-05-25T04:58:57.121 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION="9" 2024-05-25T04:58:57.121 INFO:teuthology.orchestra.run.smithi088.stdout:ID="centos" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:ID_LIKE="rhel fedora" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:VERSION_ID="9" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:PLATFORM_ID="platform:el9" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:ANSI_COLOR="0;31" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:LOGO="fedora-logo-icon" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:HOME_URL="https://centos.org/" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-25T04:58:57.122 INFO:teuthology.orchestra.run.smithi088.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-25T04:58:57.123 INFO:teuthology.lock.ops:Updating smithi088.front.sepia.ceph.com on lock server 2024-05-25T04:58:57.143 DEBUG:teuthology.orchestra.run.smithi136:> uname -m 2024-05-25T04:58:57.161 INFO:teuthology.orchestra.run.smithi136.stdout:x86_64 2024-05-25T04:58:57.162 DEBUG:teuthology.orchestra.run.smithi136:> cat /etc/os-release 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:NAME="CentOS Stream" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION="9" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:ID="centos" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:ID_LIKE="rhel fedora" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:VERSION_ID="9" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:PLATFORM_ID="platform:el9" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:PRETTY_NAME="CentOS Stream 9" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:ANSI_COLOR="0;31" 2024-05-25T04:58:57.220 INFO:teuthology.orchestra.run.smithi136.stdout:LOGO="fedora-logo-icon" 2024-05-25T04:58:57.221 INFO:teuthology.orchestra.run.smithi136.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-05-25T04:58:57.221 INFO:teuthology.orchestra.run.smithi136.stdout:HOME_URL="https://centos.org/" 2024-05-25T04:58:57.221 INFO:teuthology.orchestra.run.smithi136.stdout:BUG_REPORT_URL="https://bugzilla.redhat.com/" 2024-05-25T04:58:57.221 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-05-25T04:58:57.221 INFO:teuthology.orchestra.run.smithi136.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-05-25T04:58:57.221 INFO:teuthology.lock.ops:Updating smithi136.front.sepia.ceph.com on lock server 2024-05-25T04:58:57.242 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-05-25T04:58:57.251 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-05-25T04:58:57.258 INFO:teuthology.task.internal:Checking for old test directory... 2024-05-25T04:58:57.259 DEBUG:teuthology.orchestra.run.smithi088:> test '!' -e /home/ubuntu/cephtest 2024-05-25T04:58:57.262 DEBUG:teuthology.orchestra.run.smithi136:> test '!' -e /home/ubuntu/cephtest 2024-05-25T04:58:57.279 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-05-25T04:58:57.288 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-05-25T04:58:57.288 DEBUG:teuthology.orchestra.run.smithi088:> test -z $(ls -A /var/lib/ceph) 2024-05-25T04:58:57.319 DEBUG:teuthology.orchestra.run.smithi136:> test -z $(ls -A /var/lib/ceph) 2024-05-25T04:58:57.404 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-05-25T04:58:57.459 INFO:teuthology.run_tasks:Running task kernel... 2024-05-25T04:58:57.474 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-05-25T04:58:57.474 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mon.b': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-05-25T04:58:57.475 DEBUG:teuthology.orchestra.run.smithi088:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-25T04:58:57.475 DEBUG:teuthology.orchestra.run.smithi136:> test -f /run/.containerenv -o -f /.dockerenv 2024-05-25T04:58:57.491 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T04:58:57.492 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-05-25T04:58:57.492 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T04:58:57.493 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-05-25T04:58:57.549 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-437.el9.x86_64 2024-05-25T04:58:57.550 INFO:teuthology.task.kernel:Running kernel on smithi088: 5.14.0-437.el9.x86_64 2024-05-25T04:58:57.550 DEBUG:teuthology.orchestra.run.smithi088:> sudo yum install -y kernel 2024-05-25T04:58:57.551 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-437.el9.x86_64 2024-05-25T04:58:57.551 INFO:teuthology.task.kernel:Running kernel on smithi136: 5.14.0-437.el9.x86_64 2024-05-25T04:58:57.551 DEBUG:teuthology.orchestra.run.smithi136:> sudo yum install -y kernel 2024-05-25T04:59:00.071 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - BaseOS 9.4 MB/s | 8.1 MB 00:00 2024-05-25T04:59:01.519 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - BaseOS 3.6 MB/s | 8.1 MB 00:02 2024-05-25T04:59:04.188 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - AppStream 6.3 MB/s | 19 MB 00:03 2024-05-25T04:59:04.737 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - AppStream 8.8 MB/s | 19 MB 00:02 2024-05-25T04:59:09.112 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - CRB 8.1 MB/s | 6.2 MB 00:00 2024-05-25T04:59:09.830 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - CRB 3.2 MB/s | 6.2 MB 00:01 2024-05-25T04:59:10.988 INFO:teuthology.orchestra.run.smithi136.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 17 kB 00:00 2024-05-25T04:59:11.397 INFO:teuthology.orchestra.run.smithi088.stdout:CentOS Stream 9 - Extras packages 39 kB/s | 17 kB 00:00 2024-05-25T04:59:12.756 INFO:teuthology.orchestra.run.smithi136.stdout:Extra Packages for Enterprise Linux 13 MB/s | 21 MB 00:01 2024-05-25T04:59:13.059 INFO:teuthology.orchestra.run.smithi088.stdout:Extra Packages for Enterprise Linux 14 MB/s | 21 MB 00:01 2024-05-25T04:59:17.972 INFO:teuthology.orchestra.run.smithi136.stdout:lab-extras 16 kB/s | 1.7 kB 00:00 2024-05-25T04:59:18.148 INFO:teuthology.orchestra.run.smithi088.stdout:lab-extras 38 kB/s | 1.7 kB 00:00 2024-05-25T04:59:18.162 INFO:teuthology.orchestra.run.smithi136.stdout:Last metadata expiration check: 0:00:01 ago on Sat 25 May 2024 04:59:17 AM UTC. 2024-05-25T04:59:19.903 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-25T04:59:19.903 INFO:teuthology.orchestra.run.smithi136.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-25T04:59:19.989 INFO:teuthology.orchestra.run.smithi136.stdout:Dependencies resolved. 2024-05-25T04:59:19.999 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-05-25T04:59:19.999 INFO:teuthology.orchestra.run.smithi136.stdout: Package Architecture Version Repository Size 2024-05-25T04:59:19.999 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-05-25T04:59:19.999 INFO:teuthology.orchestra.run.smithi136.stdout:Installing: 2024-05-25T04:59:19.999 INFO:teuthology.orchestra.run.smithi136.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout:Installing dependencies: 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction Summary 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout:================================================================================ 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout:Install 4 Packages 2024-05-25T04:59:20.000 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T04:59:20.001 INFO:teuthology.orchestra.run.smithi136.stdout:Total download size: 78 M 2024-05-25T04:59:20.001 INFO:teuthology.orchestra.run.smithi136.stdout:Installed size: 123 M 2024-05-25T04:59:20.001 INFO:teuthology.orchestra.run.smithi136.stdout:Downloading Packages: 2024-05-25T04:59:20.054 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-05-25T04:59:20.054 INFO:teuthology.orchestra.run.smithi088.stdout:Package kernel-5.14.0-437.el9.x86_64 is already installed. 2024-05-25T04:59:20.152 INFO:teuthology.orchestra.run.smithi088.stdout:Dependencies resolved. 2024-05-25T04:59:20.164 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-05-25T04:59:20.164 INFO:teuthology.orchestra.run.smithi088.stdout: Package Architecture Version Repository Size 2024-05-25T04:59:20.164 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout:Installing: 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout: kernel x86_64 5.14.0-447.el9 baseos 576 k 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout:Installing dependencies: 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core x86_64 5.14.0-447.el9 baseos 16 M 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules x86_64 5.14.0-447.el9 baseos 34 M 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core x86_64 5.14.0-447.el9 baseos 28 M 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction Summary 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout:================================================================================ 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout:Install 4 Packages 2024-05-25T04:59:20.165 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T04:59:20.166 INFO:teuthology.orchestra.run.smithi088.stdout:Total download size: 78 M 2024-05-25T04:59:20.166 INFO:teuthology.orchestra.run.smithi088.stdout:Installed size: 123 M 2024-05-25T04:59:20.166 INFO:teuthology.orchestra.run.smithi088.stdout:Downloading Packages: 2024-05-25T04:59:20.366 INFO:teuthology.orchestra.run.smithi088.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 3.4 MB/s | 576 kB 00:00 2024-05-25T04:59:20.733 INFO:teuthology.orchestra.run.smithi088.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 29 MB/s | 16 MB 00:00 2024-05-25T04:59:21.133 INFO:teuthology.orchestra.run.smithi088.stdout:(3/4): kernel-modules-core-5.14.0-447.el9.x86_6 37 MB/s | 28 MB 00:00 2024-05-25T04:59:21.365 INFO:teuthology.orchestra.run.smithi136.stdout:(1/4): kernel-5.14.0-447.el9.x86_64.rpm 449 kB/s | 576 kB 00:01 2024-05-25T04:59:21.791 INFO:teuthology.orchestra.run.smithi088.stdout:(4/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 21 MB/s | 34 MB 00:01 2024-05-25T04:59:21.792 INFO:teuthology.orchestra.run.smithi088.stdout:-------------------------------------------------------------------------------- 2024-05-25T04:59:21.792 INFO:teuthology.orchestra.run.smithi088.stdout:Total 48 MB/s | 78 MB 00:01 2024-05-25T04:59:22.032 INFO:teuthology.orchestra.run.smithi136.stdout:(2/4): kernel-core-5.14.0-447.el9.x86_64.rpm 8.0 MB/s | 16 MB 00:01 2024-05-25T04:59:22.484 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction check 2024-05-25T04:59:22.824 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction check succeeded. 2024-05-25T04:59:22.824 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction test 2024-05-25T04:59:22.890 INFO:teuthology.orchestra.run.smithi136.stdout:(3/4): kernel-modules-5.14.0-447.el9.x86_64.rpm 12 MB/s | 34 MB 00:02 2024-05-25T04:59:23.762 INFO:teuthology.orchestra.run.smithi088.stdout:Transaction test succeeded. 2024-05-25T04:59:23.762 INFO:teuthology.orchestra.run.smithi088.stdout:Running transaction 2024-05-25T04:59:23.865 INFO:teuthology.orchestra.run.smithi136.stdout:(4/4): kernel-modules-core-5.14.0-447.el9.x86_6 11 MB/s | 28 MB 00:02 2024-05-25T04:59:23.866 INFO:teuthology.orchestra.run.smithi136.stdout:-------------------------------------------------------------------------------- 2024-05-25T04:59:23.866 INFO:teuthology.orchestra.run.smithi136.stdout:Total 20 MB/s | 78 MB 00:03 2024-05-25T04:59:24.551 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction check 2024-05-25T04:59:24.906 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction check succeeded. 2024-05-25T04:59:24.906 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction test 2024-05-25T04:59:25.839 INFO:teuthology.orchestra.run.smithi136.stdout:Transaction test succeeded. 2024-05-25T04:59:25.839 INFO:teuthology.orchestra.run.smithi136.stdout:Running transaction 2024-05-25T04:59:26.137 INFO:teuthology.orchestra.run.smithi088.stdout: Preparing : 1/1 2024-05-25T04:59:26.743 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-25T04:59:26.832 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-25T04:59:28.210 INFO:teuthology.orchestra.run.smithi136.stdout: Preparing : 1/1 2024-05-25T04:59:28.927 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-core-5.14.0-447.el9.x86_64 1/4 2024-05-25T04:59:29.008 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-25T04:59:29.495 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-25T04:59:29.634 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-25T04:59:31.671 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-25T04:59:31.808 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-25T04:59:34.381 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-25T04:59:34.528 INFO:teuthology.orchestra.run.smithi088.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-25T04:59:36.549 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-25T04:59:36.644 INFO:teuthology.orchestra.run.smithi136.stdout: Installing : kernel-5.14.0-447.el9.x86_64 4/4 2024-05-25T04:59:39.258 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-25T04:59:41.347 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:08.762 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:08.801 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:09.093 INFO:teuthology.orchestra.run.smithi088.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:09.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-25T05:00:09.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-25T05:00:09.093 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-25T05:00:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:09.885 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:00:09.886 INFO:teuthology.orchestra.run.smithi088.stdout:Installed: 2024-05-25T05:00:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-25T05:00:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-25T05:00:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-25T05:00:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-25T05:00:09.886 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:00:09.886 INFO:teuthology.orchestra.run.smithi088.stdout:Complete! 2024-05-25T05:00:10.243 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-05-25T05:00:10.326 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-25T05:00:10.326 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-25T05:00:10.326 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-25T05:00:10.326 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-25T05:00:10.326 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-25T05:00:10.327 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-05-25T05:00:10.327 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi088.front.sepia.ceph.com, path=None, version=distro) 2024-05-25T05:00:10.327 DEBUG:teuthology.orchestra.run.smithi088:> rpm -q kernel | sort -rV | head -n 1 2024-05-25T05:00:10.376 INFO:teuthology.orchestra.run.smithi088.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-25T05:00:10.377 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-25T05:00:10.377 DEBUG:teuthology.orchestra.run.smithi088:> sudo rpm -qi grub2-tools 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Name : grub2-tools 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Epoch : 1 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Version : 2.06 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Release : 68.el9 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Architecture: x86_64 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Group : Unspecified 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Size : 8264254 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:License : GPLv3+ 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-25T05:00:10.410 INFO:teuthology.orchestra.run.smithi088.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:Packager : builder@centos.org 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:Vendor : CentOS 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:Summary : Support tools for GRUB. 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:Description : 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:hardware devices. 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:00:10.411 INFO:teuthology.orchestra.run.smithi088.stdout:This subpackage provides tools for support of all platforms. 2024-05-25T05:00:10.412 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-25T05:00:10.412 INFO:teuthology.task.kernel:Updating grub on smithi088 to boot 5.14.0-447.el9.x86_64 2024-05-25T05:00:10.412 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-25T05:00:11.035 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-core-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:11.074 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-modules-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:11.076 INFO:teuthology.orchestra.run.smithi088.stderr:Generating grub configuration file ... 2024-05-25T05:00:11.415 INFO:teuthology.orchestra.run.smithi136.stdout: Running scriptlet: kernel-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:11.415 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-5.14.0-447.el9.x86_64 1/4 2024-05-25T05:00:11.415 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-core-5.14.0-447.el9.x86_64 2/4 2024-05-25T05:00:11.415 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-5.14.0-447.el9.x86_64 3/4 2024-05-25T05:00:12.214 INFO:teuthology.orchestra.run.smithi136.stdout: Verifying : kernel-modules-core-5.14.0-447.el9.x86_64 4/4 2024-05-25T05:00:12.214 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T05:00:12.214 INFO:teuthology.orchestra.run.smithi136.stdout:Installed: 2024-05-25T05:00:12.214 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-5.14.0-447.el9.x86_64 2024-05-25T05:00:12.214 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-core-5.14.0-447.el9.x86_64 2024-05-25T05:00:12.214 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-5.14.0-447.el9.x86_64 2024-05-25T05:00:12.214 INFO:teuthology.orchestra.run.smithi136.stdout: kernel-modules-core-5.14.0-447.el9.x86_64 2024-05-25T05:00:12.215 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T05:00:12.215 INFO:teuthology.orchestra.run.smithi136.stdout:Complete! 2024-05-25T05:00:12.475 INFO:teuthology.orchestra.run.smithi088.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-25T05:00:12.501 INFO:teuthology.orchestra.run.smithi088.stderr:done 2024-05-25T05:00:12.504 DEBUG:teuthology.orchestra.run.smithi088:> mktemp 2024-05-25T05:00:12.520 INFO:teuthology.orchestra.run.smithi088.stdout:/tmp/tmp.J6p9ETaDrw 2024-05-25T05:00:12.520 DEBUG:teuthology.orchestra.run.smithi088:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.J6p9ETaDrw 2024-05-25T05:00:12.580 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-05-25T05:00:12.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0666 /tmp/tmp.J6p9ETaDrw 2024-05-25T05:00:12.642 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-25T05:00:12.643 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-25T05:00:12.643 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-437.el9.x86_64 Expected: 5.14.0-447.el9.x86_64 2024-05-25T05:00:12.643 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-05-25T05:00:12.643 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-05-25T05:00:12.643 INFO:teuthology.task.kernel:Installing distro kernel on mon.b... 2024-05-25T05:00:12.644 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi136.front.sepia.ceph.com, path=None, version=distro) 2024-05-25T05:00:12.644 DEBUG:teuthology.orchestra.run.smithi136:> rpm -q kernel | sort -rV | head -n 1 2024-05-25T05:00:12.695 INFO:teuthology.orchestra.run.smithi136.stdout:kernel-5.14.0-447.el9.x86_64 2024-05-25T05:00:12.696 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-447.el9.x86_64 2024-05-25T05:00:12.696 DEBUG:teuthology.orchestra.run.smithi136:> sudo rpm -qi grub2-tools 2024-05-25T05:00:12.726 INFO:teuthology.orchestra.run.smithi136.stdout:Name : grub2-tools 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Epoch : 1 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Version : 2.06 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Release : 68.el9 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Architecture: x86_64 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Install Date: Fri 19 Apr 2024 09:32:39 PM UTC 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Group : Unspecified 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Size : 8264254 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:License : GPLv3+ 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Signature : RSA/SHA256, Mon 07 Aug 2023 01:57:16 PM UTC, Key ID 05b555b38483c65d 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Source RPM : grub2-2.06-68.el9.src.rpm 2024-05-25T05:00:12.727 INFO:teuthology.orchestra.run.smithi136.stdout:Build Date : Wed 02 Aug 2023 03:15:48 PM UTC 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:Packager : builder@centos.org 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:Vendor : CentOS 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:URL : http://www.gnu.org/software/grub/ 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:Summary : Support tools for GRUB. 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:Description : 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:customizable bootloader with modular architecture. It supports a rich 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:variety of kernel formats, file systems, computer architectures and 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:hardware devices. 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T05:00:12.728 INFO:teuthology.orchestra.run.smithi136.stdout:This subpackage provides tools for support of all platforms. 2024-05-25T05:00:12.729 DEBUG:teuthology.orchestra.remote:smithi088:/tmp/tmp.J6p9ETaDrw is 6KB 2024-05-25T05:00:12.730 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-05-25T05:00:12.730 INFO:teuthology.task.kernel:Updating grub on smithi136 to boot 5.14.0-447.el9.x86_64 2024-05-25T05:00:12.730 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-05-25T05:00:12.778 DEBUG:teuthology.orchestra.run.smithi088:> rm -fr /tmp/tmp.J6p9ETaDrw 2024-05-25T05:00:12.792 DEBUG:teuthology.orchestra.run.smithi088:> sudo /bin/ls /boot/loader/entries || true 2024-05-25T05:00:12.856 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-25T05:00:12.856 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-25T05:00:12.856 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-25T05:00:12.856 INFO:teuthology.orchestra.run.smithi088.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-25T05:00:12.857 DEBUG:teuthology.orchestra.run.smithi088:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-25T05:00:13.011 DEBUG:teuthology.orchestra.run.smithi088:> sudo shutdown -r now 2024-05-25T05:00:13.423 INFO:teuthology.orchestra.run.smithi136.stderr:Generating grub configuration file ... 2024-05-25T05:00:14.839 INFO:teuthology.orchestra.run.smithi136.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-05-25T05:00:14.865 INFO:teuthology.orchestra.run.smithi136.stderr:done 2024-05-25T05:00:14.867 DEBUG:teuthology.orchestra.run.smithi136:> mktemp 2024-05-25T05:00:14.923 INFO:teuthology.orchestra.run.smithi136.stdout:/tmp/tmp.QxXqtEnlWK 2024-05-25T05:00:14.923 DEBUG:teuthology.orchestra.run.smithi136:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.QxXqtEnlWK 2024-05-25T05:00:14.995 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0666 /tmp/tmp.QxXqtEnlWK 2024-05-25T05:00:15.129 DEBUG:teuthology.orchestra.remote:smithi136:/tmp/tmp.QxXqtEnlWK is 6KB 2024-05-25T05:00:15.177 DEBUG:teuthology.orchestra.run.smithi136:> rm -fr /tmp/tmp.QxXqtEnlWK 2024-05-25T05:00:15.191 DEBUG:teuthology.orchestra.run.smithi136:> sudo /bin/ls /boot/loader/entries || true 2024-05-25T05:00:15.253 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-0-rescue.conf 2024-05-25T05:00:15.253 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-239.el9.x86_64.conf 2024-05-25T05:00:15.253 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-437.el9.x86_64.conf 2024-05-25T05:00:15.253 INFO:teuthology.orchestra.run.smithi136.stdout:7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64.conf 2024-05-25T05:00:15.254 DEBUG:teuthology.orchestra.run.smithi136:> sudo grub2-set-default 7fc8828e06d0482694bcf4a447d13cb6-5.14.0-447.el9.x86_64 2024-05-25T05:00:15.406 DEBUG:teuthology.orchestra.run.smithi136:> sudo shutdown -r now 2024-05-25T05:00:43.038 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-05-25T05:00:43.039 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:00:43.040 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:00:45.410 INFO:teuthology.task.kernel:Checking client mon.b for new kernel version... 2024-05-25T05:00:45.411 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-25T05:00:45.411 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:01:01.598 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-25T05:01:10.608 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:01:10.609 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:01:13.662 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-25T05:01:20.030 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-05-25T05:01:25.666 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:01:25.667 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:01:28.738 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-25T05:01:29.032 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-25T05:01:29.033 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:01:43.750 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:01:43.751 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:01:47.426 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.136 2024-05-25T05:01:59.438 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-25T05:01:59.439 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:01:59.860 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-05-25T05:02:00.239 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-25T05:02:00.239 INFO:teuthology.task.kernel:Checking kernel version of mon.b, want "5.14.0-447.el9.x86_64"... 2024-05-25T05:02:00.239 DEBUG:teuthology.orchestra.run.smithi136:> uname -r 2024-05-25T05:02:00.254 INFO:teuthology.orchestra.run.smithi136.stdout:5.14.0-447.el9.x86_64 2024-05-25T05:02:00.254 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-25T05:02:00.254 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-25T05:02:00.254 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-25T05:02:01.255 INFO:teuthology.task.kernel:Enabling kdb on mon.b... 2024-05-25T05:02:01.256 DEBUG:teuthology.orchestra.run.smithi136:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-25T05:02:01.329 INFO:teuthology.orchestra.run.smithi136.stdout:ttyS1 2024-05-25T05:02:01.374 DEBUG:teuthology.parallel:result is None 2024-05-25T05:02:02.270 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.88 2024-05-25T05:02:20.271 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:02:20.272 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:02:20.550 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-05-25T05:02:20.950 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:02:20.950 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-447.el9.x86_64"... 2024-05-25T05:02:20.950 DEBUG:teuthology.orchestra.run.smithi088:> uname -r 2024-05-25T05:02:20.967 INFO:teuthology.orchestra.run.smithi088.stdout:5.14.0-447.el9.x86_64 2024-05-25T05:02:20.967 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-447.el9.x86_64 vs 5.14.0-447.el9.x86_64 2024-05-25T05:02:20.968 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-05-25T05:02:20.968 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-05-25T05:02:21.969 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-05-25T05:02:21.969 DEBUG:teuthology.orchestra.run.smithi088:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-05-25T05:02:22.030 INFO:teuthology.orchestra.run.smithi088.stdout:ttyS1 2024-05-25T05:02:22.069 DEBUG:teuthology.parallel:result is None 2024-05-25T05:02:22.069 INFO:teuthology.run_tasks:Running task internal.base... 2024-05-25T05:02:22.076 INFO:teuthology.task.internal:Creating test directory... 2024-05-25T05:02:22.076 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-25T05:02:22.079 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-05-25T05:02:22.099 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-05-25T05:02:22.105 INFO:teuthology.run_tasks:Running task internal.archive... 2024-05-25T05:02:22.115 INFO:teuthology.task.internal:Creating archive directory... 2024-05-25T05:02:22.115 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-25T05:02:22.138 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-05-25T05:02:22.180 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-05-25T05:02:22.187 INFO:teuthology.task.internal:Enabling coredump saving... 2024-05-25T05:02:22.187 DEBUG:teuthology.orchestra.run.smithi088:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-25T05:02:22.201 DEBUG:teuthology.orchestra.run.smithi136:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-05-25T05:02:22.236 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-25T05:02:22.244 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-25T05:02:22.248 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-25T05:02:22.255 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-05-25T05:02:22.257 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-05-25T05:02:22.264 INFO:teuthology.task.internal:Configuring sudo... 2024-05-25T05:02:22.264 DEBUG:teuthology.orchestra.run.smithi088:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-25T05:02:22.293 DEBUG:teuthology.orchestra.run.smithi136:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-05-25T05:02:22.324 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-05-25T05:02:22.333 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-05-25T05:02:22.333 DEBUG:teuthology.orchestra.run.smithi088:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-25T05:02:22.363 DEBUG:teuthology.orchestra.run.smithi136:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-05-25T05:02:22.380 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-25T05:02:22.466 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-25T05:02:22.514 DEBUG:teuthology.orchestra.run.smithi088:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-25T05:02:22.596 DEBUG:teuthology.orchestra.run.smithi088:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-25T05:02:22.641 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:02:22.641 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-25T05:02:22.707 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-25T05:02:22.751 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-05-25T05:02:22.797 DEBUG:teuthology.orchestra.run.smithi136:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-25T05:02:22.882 DEBUG:teuthology.orchestra.run.smithi136:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-05-25T05:02:22.922 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-25T05:02:22.922 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-05-25T05:02:22.988 DEBUG:teuthology.orchestra.run.smithi088:> sudo service rsyslog restart 2024-05-25T05:02:22.992 DEBUG:teuthology.orchestra.run.smithi136:> sudo service rsyslog restart 2024-05-25T05:02:23.042 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-25T05:02:23.088 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-25T05:02:23.550 INFO:teuthology.run_tasks:Running task internal.timer... 2024-05-25T05:02:23.557 INFO:teuthology.task.internal:Starting timer... 2024-05-25T05:02:23.557 INFO:teuthology.run_tasks:Running task pcp... 2024-05-25T05:02:23.578 INFO:teuthology.run_tasks:Running task selinux... 2024-05-25T05:02:23.587 DEBUG:teuthology.orchestra.run.smithi088:> sudo service auditd rotate 2024-05-25T05:02:23.661 INFO:teuthology.orchestra.run.smithi088.stdout:Rotating logs: 2024-05-25T05:02:23.663 DEBUG:teuthology.orchestra.run.smithi136:> sudo service auditd rotate 2024-05-25T05:02:23.727 INFO:teuthology.orchestra.run.smithi136.stdout:Rotating logs: 2024-05-25T05:02:23.729 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-05-25T05:02:23.729 DEBUG:teuthology.orchestra.run.smithi088:> /usr/sbin/getenforce 2024-05-25T05:02:23.762 INFO:teuthology.orchestra.run.smithi088.stdout:Permissive 2024-05-25T05:02:23.762 DEBUG:teuthology.orchestra.run.smithi136:> /usr/sbin/getenforce 2024-05-25T05:02:23.793 INFO:teuthology.orchestra.run.smithi136.stdout:Permissive 2024-05-25T05:02:23.793 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi088.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi136.front.sepia.ceph.com': 'permissive'} 2024-05-25T05:02:23.794 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-25T05:02:23.830 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T05:02:23.830 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-25T05:02:23.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T05:02:23.860 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-05-25T05:02:23.860 DEBUG:teuthology.orchestra.run.smithi088:> sudo /usr/sbin/setenforce permissive 2024-05-25T05:02:23.897 DEBUG:teuthology.orchestra.run.smithi136:> sudo /usr/sbin/setenforce permissive 2024-05-25T05:02:23.925 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-05-25T05:02:23.935 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-05-25T05:02:23.949 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-05-25T05:02:23.951 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi088.front.sepia.ceph.com,smithi136.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-05-25T05:06:53.795 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi088.front.sepia.ceph.com'), Remote(name='ubuntu@smithi136.front.sepia.ceph.com')] 2024-05-25T05:06:53.797 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:06:53.798 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi088.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:06:53.871 DEBUG:teuthology.orchestra.run.smithi088:> true 2024-05-25T05:06:53.946 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi088.front.sepia.ceph.com' 2024-05-25T05:06:53.946 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-25T05:06:53.947 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi136.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-05-25T05:06:54.022 DEBUG:teuthology.orchestra.run.smithi136:> true 2024-05-25T05:06:54.098 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi136.front.sepia.ceph.com' 2024-05-25T05:06:54.098 INFO:teuthology.run_tasks:Running task clock... 2024-05-25T05:06:54.109 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-05-25T05:06:54.110 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-25T05:06:54.110 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-25T05:06:54.113 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-05-25T05:06:54.113 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-25T05:06:54.140 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-25T05:06:54.154 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-25T05:06:54.168 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-05-25T05:06:54.177 INFO:teuthology.orchestra.run.smithi088.stderr:sudo: ntpd: command not found 2024-05-25T05:06:54.183 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-05-25T05:06:54.188 INFO:teuthology.orchestra.run.smithi088.stdout:506 Cannot talk to daemon 2024-05-25T05:06:54.202 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-25T05:06:54.208 INFO:teuthology.orchestra.run.smithi136.stderr:sudo: ntpd: command not found 2024-05-25T05:06:54.216 INFO:teuthology.orchestra.run.smithi088.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-25T05:06:54.219 INFO:teuthology.orchestra.run.smithi136.stdout:506 Cannot talk to daemon 2024-05-25T05:06:54.233 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-05-25T05:06:54.247 INFO:teuthology.orchestra.run.smithi136.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-05-25T05:06:54.271 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-05-25T05:06:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-25T05:06:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-05-25T05:06:54.274 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.275 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.275 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.275 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.304 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-05-25T05:06:54.308 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-25T05:06:54.308 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-05-25T05:06:54.308 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.308 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.308 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.308 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:06:54.309 INFO:teuthology.run_tasks:Running task cephadm... 2024-05-25T05:06:54.396 INFO:tasks.cephadm:Config: {'cephadm_branch': 'v17.2.0', 'cephadm_git_url': 'https://github.com/ceph/ceph', 'image': 'quay.io/ceph/ceph:v17.2.0', 'conf': {'global': {'mon election default strategy': 3}, 'mgr': {'debug mgr': 20, 'debug ms': 1, 'mgr/cephadm/use_agent': True}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'debug ms': 1, 'debug osd': 20}}, 'flavor': 'default', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)'], 'log-only-match': ['CEPHADM_'], 'sha1': 'ea0684c08cbcf83f4af9930de2267b3563ac5f78'} 2024-05-25T05:06:54.397 INFO:tasks.cephadm:Cluster image is quay.io/ceph/ceph:v17.2.0 2024-05-25T05:06:54.397 INFO:tasks.cephadm:Cluster fsid is 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:06:54.397 INFO:tasks.cephadm:Choosing monitor IPs and ports... 2024-05-25T05:06:54.397 INFO:tasks.cephadm:Monitor IPs: {'mon.a': '172.21.15.88', 'mon.c': '[v2:172.21.15.88:3301,v1:172.21.15.88:6790]', 'mon.b': '172.21.15.136'} 2024-05-25T05:06:54.398 INFO:tasks.cephadm:First mon is mon.a on smithi088 2024-05-25T05:06:54.398 INFO:tasks.cephadm:First mgr is y 2024-05-25T05:06:54.398 INFO:tasks.cephadm:Normalizing hostnames... 2024-05-25T05:06:54.398 DEBUG:teuthology.orchestra.run.smithi088:> sudo hostname $(hostname -s) 2024-05-25T05:06:54.424 DEBUG:teuthology.orchestra.run.smithi136:> sudo hostname $(hostname -s) 2024-05-25T05:06:54.450 INFO:tasks.cephadm:Downloading cephadm (repo https://github.com/ceph/ceph ref v17.2.0)... 2024-05-25T05:06:54.450 DEBUG:teuthology.orchestra.run.smithi088:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-25T05:06:54.692 INFO:teuthology.orchestra.run.smithi088.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 May 25 05:06 /home/ubuntu/cephtest/cephadm 2024-05-25T05:06:54.692 DEBUG:teuthology.orchestra.run.smithi136:> curl --silent https://raw.githubusercontent.com/ceph/ceph/v17.2.0/src/cephadm/cephadm > /home/ubuntu/cephtest/cephadm && ls -l /home/ubuntu/cephtest/cephadm 2024-05-25T05:06:54.855 INFO:teuthology.orchestra.run.smithi136.stdout:-rw-r--r--. 1 ubuntu ubuntu 320521 May 25 05:06 /home/ubuntu/cephtest/cephadm 2024-05-25T05:06:54.856 DEBUG:teuthology.orchestra.run.smithi088:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-25T05:06:54.872 DEBUG:teuthology.orchestra.run.smithi136:> test -s /home/ubuntu/cephtest/cephadm && test $(stat -c%s /home/ubuntu/cephtest/cephadm) -gt 1000 && chmod +x /home/ubuntu/cephtest/cephadm 2024-05-25T05:06:54.898 INFO:tasks.cephadm:Pulling image quay.io/ceph/ceph:v17.2.0 on all hosts... 2024-05-25T05:06:54.898 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-05-25T05:06:54.914 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 pull 2024-05-25T05:06:55.763 INFO:teuthology.orchestra.run.smithi136.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-05-25T05:06:55.774 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-05-25T05:07:13.147 INFO:teuthology.orchestra.run.smithi136.stdout:{ 2024-05-25T05:07:13.148 INFO:teuthology.orchestra.run.smithi136.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-05-25T05:07:13.148 INFO:teuthology.orchestra.run.smithi136.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-05-25T05:07:13.148 INFO:teuthology.orchestra.run.smithi136.stdout: "repo_digests": [ 2024-05-25T05:07:13.148 INFO:teuthology.orchestra.run.smithi136.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-05-25T05:07:13.148 INFO:teuthology.orchestra.run.smithi136.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-05-25T05:07:13.148 INFO:teuthology.orchestra.run.smithi136.stdout: ] 2024-05-25T05:07:13.148 INFO:teuthology.orchestra.run.smithi136.stdout:} 2024-05-25T05:07:16.077 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:07:16.077 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph_version": "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)", 2024-05-25T05:07:16.077 INFO:teuthology.orchestra.run.smithi088.stdout: "image_id": "e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9", 2024-05-25T05:07:16.077 INFO:teuthology.orchestra.run.smithi088.stdout: "repo_digests": [ 2024-05-25T05:07:16.078 INFO:teuthology.orchestra.run.smithi088.stdout: "quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a", 2024-05-25T05:07:16.078 INFO:teuthology.orchestra.run.smithi088.stdout: "quay.io/ceph/ceph@sha256:cb4d698cb769b6aba05bf6ef04f41a7fe694160140347576e13bd9348514b667" 2024-05-25T05:07:16.078 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-25T05:07:16.078 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:07:16.095 DEBUG:teuthology.orchestra.run.smithi088:> sudo mkdir -p /etc/ceph 2024-05-25T05:07:16.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo mkdir -p /etc/ceph 2024-05-25T05:07:16.194 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 777 /etc/ceph 2024-05-25T05:07:16.219 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 777 /etc/ceph 2024-05-25T05:07:16.264 INFO:tasks.cephadm:Writing seed config... 2024-05-25T05:07:16.265 INFO:tasks.cephadm: override: [global] mon election default strategy = 3 2024-05-25T05:07:16.265 INFO:tasks.cephadm: override: [mgr] debug mgr = 20 2024-05-25T05:07:16.265 INFO:tasks.cephadm: override: [mgr] debug ms = 1 2024-05-25T05:07:16.265 INFO:tasks.cephadm: override: [mgr] mgr/cephadm/use_agent = True 2024-05-25T05:07:16.265 INFO:tasks.cephadm: override: [mon] debug mon = 20 2024-05-25T05:07:16.266 INFO:tasks.cephadm: override: [mon] debug ms = 1 2024-05-25T05:07:16.266 INFO:tasks.cephadm: override: [mon] debug paxos = 20 2024-05-25T05:07:16.266 INFO:tasks.cephadm: override: [osd] debug ms = 1 2024-05-25T05:07:16.266 INFO:tasks.cephadm: override: [osd] debug osd = 20 2024-05-25T05:07:16.266 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:07:16.266 DEBUG:teuthology.orchestra.run.smithi088:> dd of=/home/ubuntu/cephtest/seed.ceph.conf 2024-05-25T05:07:16.281 DEBUG:tasks.cephadm:Final config: [global] # make logging friendly to teuthology log_to_file = true log_to_stderr = false log to journald = false mon cluster log to file = true mon cluster log file level = debug mon clock drift allowed = 1.000 # replicate across OSDs, not hosts osd crush chooseleaf type = 0 #osd pool default size = 2 osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd # enable some debugging auth debug = true ms die on old message = true ms die on bug = true debug asserts on shutdown = true # adjust warnings mon max pg per osd = 10000# >= luminous mon pg warn max object skew = 0 mon osd allow primary affinity = true mon osd allow pg remap = true mon warn on legacy crush tunables = false mon warn on crush straw calc version zero = false mon warn on no sortbitwise = false mon warn on osd down out interval zero = false mon warn on too few osds = false mon_warn_on_pool_pg_num_not_power_of_two = false # disable pg_autoscaler by default for new pools osd_pool_default_pg_autoscale_mode = off # tests delete pools mon allow pool delete = true fsid = 9a885618-1a54-11ef-bc9b-c7b262605968 mon election default strategy = 3 [osd] osd scrub load threshold = 5.0 osd scrub max interval = 600 osd mclock profile = high_recovery_ops osd recover clone overlap = true osd recovery max chunk = 1048576 osd deep scrub update digest min age = 30 osd map max advance = 10 osd memory target autotune = true # debugging osd debug shutdown = true osd debug op order = true osd debug verify stray on activate = true osd debug pg log writeout = true osd debug verify cached snaps = true osd debug verify missing on start = true osd debug misdirected ops = true osd op queue = debug_random osd op queue cut off = debug_random osd shutdown pgref assert = true bdev debug aio = true osd sloppy crc = true debug ms = 1 debug osd = 20 [mgr] mon reweight min pgs per osd = 4 mon reweight min bytes per osd = 10 mgr/telemetry/nag = false debug mgr = 20 debug ms = 1 mgr/cephadm/use_agent = True [mon] mon data avail warn = 5 mon mgr mkfs grace = 240 mon reweight min pgs per osd = 4 mon osd reporter subtree level = osd mon osd prime pg temp = true mon reweight min bytes per osd = 10 # rotate auth tickets quickly to exercise renewal paths auth mon ticket ttl = 660# 11m auth service ticket ttl = 240# 4m # don't complain about global id reclaim mon_warn_on_insecure_global_id_reclaim = false mon_warn_on_insecure_global_id_reclaim_allowed = false debug mon = 20 debug ms = 1 debug paxos = 20 [client.rgw] rgw cache enabled = true rgw enable ops log = true rgw enable usage log = true 2024-05-25T05:07:16.282 DEBUG:teuthology.orchestra.run.smithi088:mon.a> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service 2024-05-25T05:07:16.324 DEBUG:teuthology.orchestra.run.smithi088:mgr.y> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service 2024-05-25T05:07:16.366 INFO:tasks.cephadm:Bootstrapping... 2024-05-25T05:07:16.366 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 -v bootstrap --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 --config /home/ubuntu/cephtest/seed.ceph.conf --output-config /etc/ceph/ceph.conf --output-keyring /etc/ceph/ceph.client.admin.keyring --output-pub-ssh-key /home/ubuntu/cephtest/ceph.pub --mon-id a --mgr-id y --orphan-initial-daemons --skip-monitoring-stack --mon-ip 172.21.15.88 --skip-admin-label && sudo chmod +r /etc/ceph/ceph.client.admin.keyring 2024-05-25T05:07:16.573 INFO:teuthology.orchestra.run.smithi088.stderr:-------------------------------------------------------------------------------- 2024-05-25T05:07:16.573 INFO:teuthology.orchestra.run.smithi088.stderr:cephadm ['--image', 'quay.io/ceph/ceph:v17.2.0', '-v', 'bootstrap', '--fsid', '9a885618-1a54-11ef-bc9b-c7b262605968', '--config', '/home/ubuntu/cephtest/seed.ceph.conf', '--output-config', '/etc/ceph/ceph.conf', '--output-keyring', '/etc/ceph/ceph.client.admin.keyring', '--output-pub-ssh-key', '/home/ubuntu/cephtest/ceph.pub', '--mon-id', 'a', '--mgr-id', 'y', '--orphan-initial-daemons', '--skip-monitoring-stack', '--mon-ip', '172.21.15.88', '--skip-admin-label'] 2024-05-25T05:07:16.596 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: 5.0.2 2024-05-25T05:07:16.598 INFO:teuthology.orchestra.run.smithi088.stderr:Verifying podman|docker is present... 2024-05-25T05:07:16.620 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: 5.0.2 2024-05-25T05:07:16.622 INFO:teuthology.orchestra.run.smithi088.stderr:Verifying lvm2 is present... 2024-05-25T05:07:16.622 INFO:teuthology.orchestra.run.smithi088.stderr:Verifying time synchronization is in place... 2024-05-25T05:07:16.629 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-05-25T05:07:16.635 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: inactive 2024-05-25T05:07:16.642 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: enabled 2024-05-25T05:07:16.648 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: active 2024-05-25T05:07:16.649 INFO:teuthology.orchestra.run.smithi088.stderr:Unit chronyd.service is enabled and running 2024-05-25T05:07:16.649 INFO:teuthology.orchestra.run.smithi088.stderr:Repeating the final host check... 2024-05-25T05:07:16.670 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: 5.0.2 2024-05-25T05:07:16.672 INFO:teuthology.orchestra.run.smithi088.stderr:podman (/bin/podman) version 5.0.2 is present 2024-05-25T05:07:16.672 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl is present 2024-05-25T05:07:16.673 INFO:teuthology.orchestra.run.smithi088.stderr:lvcreate is present 2024-05-25T05:07:16.679 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Failed to get unit file state for chrony.service: No such file or directory 2024-05-25T05:07:16.685 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: inactive 2024-05-25T05:07:16.692 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: enabled 2024-05-25T05:07:16.698 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: active 2024-05-25T05:07:16.699 INFO:teuthology.orchestra.run.smithi088.stderr:Unit chronyd.service is enabled and running 2024-05-25T05:07:16.699 INFO:teuthology.orchestra.run.smithi088.stderr:Host looks OK 2024-05-25T05:07:16.699 INFO:teuthology.orchestra.run.smithi088.stderr:Cluster fsid: 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:16.699 INFO:teuthology.orchestra.run.smithi088.stderr:Acquiring lock 140282559411200 on /run/cephadm/9a885618-1a54-11ef-bc9b-c7b262605968.lock 2024-05-25T05:07:16.699 INFO:teuthology.orchestra.run.smithi088.stderr:Lock 140282559411200 acquired on /run/cephadm/9a885618-1a54-11ef-bc9b-c7b262605968.lock 2024-05-25T05:07:16.700 INFO:teuthology.orchestra.run.smithi088.stderr:Verifying IP 172.21.15.88 port 3300 ... 2024-05-25T05:07:16.700 INFO:teuthology.orchestra.run.smithi088.stderr:Verifying IP 172.21.15.88 port 6789 ... 2024-05-25T05:07:16.700 INFO:teuthology.orchestra.run.smithi088.stderr:Base mon IP is 172.21.15.88, final addrv is [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2024-05-25T05:07:16.702 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: default via 172.21.15.254 dev enp3s0f1 proto dhcp src 172.21.15.88 metric 100 2024-05-25T05:07:16.702 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: 172.21.0.0/20 dev enp3s0f1 proto kernel scope link src 172.21.15.88 metric 100 2024-05-25T05:07:16.705 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: ::1 dev lo proto kernel metric 256 pref medium 2024-05-25T05:07:16.705 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: fe80::/64 dev enp3s0f1 proto kernel metric 256 pref medium 2024-05-25T05:07:16.705 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: default via fe80::327c:5e00:6487:71e0 dev enp3s0f1 proto ra metric 1024 expires 1793sec hoplimit 64 pref medium 2024-05-25T05:07:16.707 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: 1: lo: mtu 65536 state UNKNOWN qlen 1000 2024-05-25T05:07:16.707 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: inet6 ::1/128 scope host 2024-05-25T05:07:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-05-25T05:07:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: 5: enp3s0f1: mtu 1500 state UP qlen 1000 2024-05-25T05:07:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: inet6 fe80::ec4:7aff:fe8f:d42d/64 scope link 2024-05-25T05:07:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:/sbin/ip: valid_lft forever preferred_lft forever 2024-05-25T05:07:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:Mon IP `172.21.15.88` is in CIDR network `172.21.0.0/20` 2024-05-25T05:07:16.708 INFO:teuthology.orchestra.run.smithi088.stderr:- internal network (--cluster-network) has not been provided, OSD replication will default to the public_network 2024-05-25T05:07:16.709 INFO:teuthology.orchestra.run.smithi088.stderr:Pulling container image quay.io/ceph/ceph:v17.2.0... 2024-05-25T05:07:16.810 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Trying to pull quay.io/ceph/ceph:v17.2.0... 2024-05-25T05:07:17.506 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Getting image source signatures 2024-05-25T05:07:17.507 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Copying blob sha256:33ca8fff7868c4dc0c11e09bca97c720eb9cfbab7221216754367dd8de70388a 2024-05-25T05:07:17.507 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Copying blob sha256:89b4a75bc2d8500f15463747507c9623df43886c134463e7f0527e70900e7a7b 2024-05-25T05:07:17.507 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Copying blob sha256:599d07cb321ff0a3c82224e1138fc685793fa69b93ed5780415751a5f7e4b8c2 2024-05-25T05:07:17.507 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Copying blob sha256:c32ab78b488d0c72f64eded765c0cf6b5bf2c75dab66cb62a9d367fa6ec42513 2024-05-25T05:07:17.507 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Copying blob sha256:a70843738bb77e1ab9c1f85969ebdfa55f178e746be081d1cb4f94011f69eb7c 2024-05-25T05:07:17.507 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Copying config sha256:e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-05-25T05:07:17.666 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: Writing manifest to image destination 2024-05-25T05:07:17.786 INFO:teuthology.orchestra.run.smithi088.stderr:/bin/podman: e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 2024-05-25T05:07:18.209 INFO:teuthology.orchestra.run.smithi088.stderr:ceph: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-05-25T05:07:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:Ceph version: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable) 2024-05-25T05:07:18.702 INFO:teuthology.orchestra.run.smithi088.stderr:Extracting ceph user uid/gid from container image... 2024-05-25T05:07:19.135 INFO:teuthology.orchestra.run.smithi088.stderr:stat: 167 167 2024-05-25T05:07:19.733 INFO:teuthology.orchestra.run.smithi088.stderr:Creating initial keys... 2024-05-25T05:07:20.091 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph-authtool: AQAIclFmP5bvARAA6LZpawbMB0jiNf6zHcJ0fA== 2024-05-25T05:07:21.080 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph-authtool: AQAIclFmTAJ0OxAAgIg1c/NoyI7TmSi1XRPKwA== 2024-05-25T05:07:21.995 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph-authtool: AQAJclFmv2VsNhAALtD7Q4oEBDormgClRg8Oyg== 2024-05-25T05:07:22.453 INFO:teuthology.orchestra.run.smithi088.stderr:Creating initial monmap... 2024-05-25T05:07:22.809 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-25T05:07:22.810 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/monmaptool: setting min_mon_release = octopus 2024-05-25T05:07:22.810 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: set fsid to 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:22.810 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/monmaptool: /usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-25T05:07:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:monmaptool for a [v2:172.21.15.88:3300,v1:172.21.15.88:6789] on /usr/bin/monmaptool: monmap file /tmp/monmap 2024-05-25T05:07:23.307 INFO:teuthology.orchestra.run.smithi088.stderr:setting min_mon_release = octopus 2024-05-25T05:07:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/monmaptool: set fsid to 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/monmaptool: writing epoch 0 to /tmp/monmap (1 monitors) 2024-05-25T05:07:23.308 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:07:23.308 INFO:teuthology.orchestra.run.smithi088.stderr:Creating mon... 2024-05-25T05:07:24.473 INFO:teuthology.orchestra.run.smithi088.stderr:create mon.a on 2024-05-25T05:07:24.682 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /etc/systemd/system/ceph.target. 2024-05-25T05:07:24.984 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Created symlink /etc/systemd/system/multi-user.target.wants/ceph-9a885618-1a54-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-9a885618-1a54-11ef-bc9b-c7b262605968.target. 2024-05-25T05:07:24.984 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Created symlink /etc/systemd/system/ceph.target.wants/ceph-9a885618-1a54-11ef-bc9b-c7b262605968.target → /etc/systemd/system/ceph-9a885618-1a54-11ef-bc9b-c7b262605968.target. 2024-05-25T05:07:25.600 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Failed to reset failed state of unit ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service: Unit ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service not loaded. 2024-05-25T05:07:25.607 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Created symlink /etc/systemd/system/ceph-9a885618-1a54-11ef-bc9b-c7b262605968.target.wants/ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service → /etc/systemd/system/ceph-9a885618-1a54-11ef-bc9b-c7b262605968@.service. 2024-05-25T05:07:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:26 smithi088 podman[24377]: 2024-05-25 05:07:26.069279341 +0000 UTC m=+0.017326545 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-05-25T05:07:27.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:27 smithi088 podman[24377]: 2024-05-25 05:07:27.130324625 +0000 UTC m=+1.078371810 container create 4720e74ee21593ae232a3fac5bb563da9b8192afbed256f1b864ba7eea9e0075 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, vendor=Red Hat, Inc., vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, name=centos-stream, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, io.buildah.version=1.19.8, RELEASE=HEAD, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=) 2024-05-25T05:07:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:29 smithi088 podman[24377]: 2024-05-25 05:07:29.022726528 +0000 UTC m=+2.970773723 container init 4720e74ee21593ae232a3fac5bb563da9b8192afbed256f1b864ba7eea9e0075 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, ceph=True, name=centos-stream, release=754, GIT_BRANCH=HEAD, version=8, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, RELEASE=HEAD, distribution-scope=public) 2024-05-25T05:07:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:29 smithi088 podman[24377]: 2024-05-25 05:07:29.026749672 +0000 UTC m=+2.974796863 container start 4720e74ee21593ae232a3fac5bb563da9b8192afbed256f1b864ba7eea9e0075 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , release=754, com.redhat.component=centos-stream-container, name=centos-stream, architecture=x86_64, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, io.openshift.expose-services=, io.buildah.version=1.19.8, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-05-25T05:07:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:29 smithi088 ceph-mon[24396]: mkfs 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:29 smithi088 ceph-mon[24396]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-25T05:07:29.949 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: disabled 2024-05-25T05:07:29.958 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: inactive 2024-05-25T05:07:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:firewalld.service is not enabled 2024-05-25T05:07:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:Not possible to enable service . firewalld.service is not available 2024-05-25T05:07:29.959 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for mon to start... 2024-05-25T05:07:29.960 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for mon... 2024-05-25T05:07:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:29 smithi088 bash[24377]: 4720e74ee21593ae232a3fac5bb563da9b8192afbed256f1b864ba7eea9e0075 2024-05-25T05:07:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:29 smithi088 systemd[1]: Started Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:07:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:30 smithi088 ceph-mon[24396]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-25T05:07:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:30 smithi088 ceph-mon[24396]: monmap e1: 1 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} 2024-05-25T05:07:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:30 smithi088 ceph-mon[24396]: fsmap 2024-05-25T05:07:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:30 smithi088 ceph-mon[24396]: osdmap e1: 0 total, 0 up, 0 in 2024-05-25T05:07:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:30 smithi088 ceph-mon[24396]: mgrmap e1: no daemons active 2024-05-25T05:07:33.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:32 smithi088 ceph-mon[24396]: from='client.? 172.21.15.88:0/3059006679' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: cluster: 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: id: 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: health: HEALTH_OK 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: services: 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon: 1 daemons, quorum a (age 3s) 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mgr: no daemons active 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: osd: 0 osds: 0 up, 0 in 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:33.726 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: data: 2024-05-25T05:07:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: pools: 0 pools, 0 pgs 2024-05-25T05:07:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: objects: 0 objects, 0 B 2024-05-25T05:07:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: usage: 0 B used, 0 B / 0 B avail 2024-05-25T05:07:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: pgs: 2024-05-25T05:07:33.727 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:mon is available 2024-05-25T05:07:34.833 INFO:teuthology.orchestra.run.smithi088.stderr:Assimilating anything we can from ceph.conf... 2024-05-25T05:07:35.329 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: [global] 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: fsid = 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon_host = [v2:172.21.15.88:3300,v1:172.21.15.88:6789] 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: [mgr] 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mgr/cephadm/use_agent = True 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:35.330 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: [osd] 2024-05-25T05:07:35.331 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-05-25T05:07:35.331 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-05-25T05:07:35.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:35 smithi088 ceph-mon[24396]: from='client.? 172.21.15.88:0/2643731086' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-25T05:07:35.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:35 smithi088 ceph-mon[24396]: from='client.? 172.21.15.88:0/2643731086' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-25T05:07:35.905 INFO:teuthology.orchestra.run.smithi088.stderr:Generating new minimal ceph.conf... 2024-05-25T05:07:36.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:36 smithi088 ceph-mon[24396]: from='client.? 172.21.15.88:0/1778100819' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:07:36.986 INFO:teuthology.orchestra.run.smithi088.stderr:Restarting the monitor... 2024-05-25T05:07:37.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 systemd[1]: Stopping Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:07:37.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 bash[24615]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon.a" found: no such container 2024-05-25T05:07:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[24392]: 2024-05-25T05:07:37.154+0000 7f1829ece700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:07:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[24392]: 2024-05-25T05:07:37.154+0000 7f1829ece700 -1 mon.a@0(leader) e1 *** Got Signal Terminated *** 2024-05-25T05:07:37.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 podman[24628]: 2024-05-25 05:07:37.368791087 +0000 UTC m=+0.319458017 container died 4720e74ee21593ae232a3fac5bb563da9b8192afbed256f1b864ba7eea9e0075 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , distribution-scope=public, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, vcs-type=git, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, version=8, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-05-25T05:07:37.987 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 podman[24628]: 2024-05-25 05:07:37.720146182 +0000 UTC m=+0.670813134 container cleanup 4720e74ee21593ae232a3fac5bb563da9b8192afbed256f1b864ba7eea9e0075 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., vcs-type=git, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , io.openshift.expose-services=, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, architecture=x86_64, distribution-scope=public, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, ceph=True, CEPH_POINT_RELEASE=-17.2.0, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8) 2024-05-25T05:07:37.987 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 bash[24628]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a 2024-05-25T05:07:37.987 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 bash[24654]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon.a" found: no such container 2024-05-25T05:07:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 podman[24640]: 2024-05-25 05:07:37.987649073 +0000 UTC m=+0.616663234 container remove 4720e74ee21593ae232a3fac5bb563da9b8192afbed256f1b864ba7eea9e0075 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, release=754, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, vcs-type=git, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , ceph=True, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., version=8, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=) 2024-05-25T05:07:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-25T05:07:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:37 smithi088 systemd[1]: Stopped Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:07:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 systemd[1]: Starting Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:07:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 podman[24718]: 2024-05-25 05:07:38.221809979 +0000 UTC m=+0.112107340 container create 8b3757c39634a35c544ec2b4d6956dc953c8bd86c99cdf506aaff6e57b5b78f6 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, distribution-scope=public, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., release=754, version=8, architecture=x86_64, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.buildah.version=1.19.8, GIT_CLEAN=True) 2024-05-25T05:07:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 podman[24718]: 2024-05-25 05:07:38.127766992 +0000 UTC m=+0.018064352 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-05-25T05:07:38.501 INFO:teuthology.orchestra.run.smithi088.stderr:Setting mon public_network to 172.21.0.0/20 2024-05-25T05:07:38.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 podman[24718]: 2024-05-25 05:07:38.424122871 +0000 UTC m=+0.314420221 container init 8b3757c39634a35c544ec2b4d6956dc953c8bd86c99cdf506aaff6e57b5b78f6 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, com.redhat.component=centos-stream-container, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, name=centos-stream, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=754, io.openshift.expose-services=) 2024-05-25T05:07:38.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 podman[24718]: 2024-05-25 05:07:38.427144344 +0000 UTC m=+0.317441686 container start 8b3757c39634a35c544ec2b4d6956dc953c8bd86c99cdf506aaff6e57b5b78f6 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, name=centos-stream, maintainer=Guillaume Abrioux , vcs-type=git, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, release=754, io.openshift.expose-services=) 2024-05-25T05:07:38.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: set uid:gid to 167:167 (ceph:ceph) 2024-05-25T05:07:38.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-05-25T05:07:38.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: pidfile_write: ignore empty --pid-file 2024-05-25T05:07:38.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: load: jerasure load: lrc 2024-05-25T05:07:38.626 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: RocksDB version: 6.15.5 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Compile date Apr 18 2022 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: DB SUMMARY 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: DB Session ID: P16SO8TDNW1G2JOLPYRI 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: CURRENT file: CURRENT 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: IDENTITY file: IDENTITY 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: MANIFEST file: MANIFEST-000009 size: 131 Bytes 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000008.sst 2024-05-25T05:07:38.627 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000010.log size: 83431 ; 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.error_if_exists: 0 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.create_if_missing: 0 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.paranoid_checks: 1 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.env: 0x55e3be4c6860 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.fs: Posix File System 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.info_log: 0x55e3bf603dc0 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_file_opening_threads: 16 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.statistics: (nil) 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.use_fsync: 0 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_log_file_size: 0 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.keep_log_file_num: 1000 2024-05-25T05:07:38.628 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.recycle_log_file_num: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.allow_fallocate: 1 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.allow_mmap_reads: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.allow_mmap_writes: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.use_direct_reads: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.create_missing_column_families: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.db_log_dir: 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-a/store.db 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-25T05:07:38.629 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.advise_random_on_open: 1 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.db_write_buffer_size: 0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.write_buffer_manager: 0x55e3bf6f42a0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.rate_limiter: (nil) 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.wal_recovery_mode: 2 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.enable_thread_tracking: 0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.enable_pipelined_write: 0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.unordered_write: 0 2024-05-25T05:07:38.630 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.row_cache: None 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.wal_filter: None 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.allow_ingest_behind: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.preserve_deletes: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.two_write_queues: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.manual_wal_flush: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.atomic_flush: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.log_readahead_size: 0 2024-05-25T05:07:38.631 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.best_efforts_recovery: 0 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.allow_data_in_errors: 0 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.db_host_id: __hostname__ 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_background_jobs: 2 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_background_compactions: -1 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_subcompactions: 1 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_total_wal_size: 0 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-25T05:07:38.632 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_open_files: -1 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bytes_per_sync: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_readahead_size: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_background_flushes: -1 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Compression algorithms supported: 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kZSTD supported: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kXpressCompression supported: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kLZ4HCCompression supported: 1 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kLZ4Compression supported: 1 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kBZip2Compression supported: 0 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kZlibCompression supported: 1 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: kSnappyCompression supported: 1 2024-05-25T05:07:38.633 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.merge_operator: 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_filter: None 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_filter_factory: None 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.sst_partitioner_factory: None 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55e3bf5cfd00) 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-25T05:07:38.634 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_type: 0 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_index_type: 0 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_shortening: 1 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: hash_index_allow_collision: 1 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: checksum: 1 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: no_block_cache: 0 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache: 0x55e3bf63a170 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_options: 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: capacity : 536870912 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: num_shard_bits : 4 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: strict_capacity_limit : 0 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-05-25T05:07:38.635 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_compressed: (nil) 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: persistent_cache: (nil) 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size: 4096 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size_deviation: 10 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_restart_interval: 16 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_block_restart_interval: 1 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: metadata_block_size: 4096 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: partition_filters: 0 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_delta_encoding: 1 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: whole_key_filtering: 1 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: verify_compression: 0 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: format_version: 4 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_index_compression: 1 2024-05-25T05:07:38.636 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_align: 0 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.write_buffer_size: 33554432 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_write_buffer_number: 2 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression: NoCompression 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression: Disabled 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.prefix_extractor: nullptr 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.num_levels: 7 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-25T05:07:38.637 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression_opts.level: 32767 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression_opts.strategy: 0 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compression_opts.enabled: false 2024-05-25T05:07:38.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-25T05:07:38.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-25T05:07:38.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-25T05:07:38.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.target_file_size_base: 67108864 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-25T05:07:38.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.arena_block_size: 4194304 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.disable_auto_compactions: 0 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-25T05:07:38.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.table_properties_collectors: 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.inplace_update_support: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.bloom_locality: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.max_successive_merges: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.paranoid_file_checks: 0 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.force_consistency_checks: 1 2024-05-25T05:07:38.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.report_bg_io_stats: 0 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.ttl: 2592000 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.enable_blob_files: false 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.min_blob_size: 0 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.blob_file_size: 268435456 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 11, last_sequence is 5, log_number is 5,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 5 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/version_set.cc:4083] Creating manifest 13 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716613658452605, "job": 1, "event": "recovery_started", "wal_files": [10]} 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #10 mode 2 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-05-25T05:07:38.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716613658453300, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 14, "file_size": 79627, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 77871, "index_size": 244, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 10073, "raw_average_key_size": 47, "raw_value_size": 72122, "raw_average_value_size": 337, "num_data_blocks": 11, "num_entries": 214, "num_deletions": 3, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1716613658, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "6c07ece8-8f23-499f-9443-2d6e825ddc44", "db_session_id": "P16SO8TDNW1G2JOLPYRI"}} 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/version_set.cc:4083] Creating manifest 15 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716613658453621, "job": 1, "event": "recovery_finished"} 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000010.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55e3bf620a80 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: DB pointer 0x55e3bf630000 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** DB Stats ** 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:07:38.644 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: L0 2/0 79.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 165.1 0.00 0.00 1 0.000 0 0 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: Sum 2/0 79.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 165.1 0.00 0.00 1 0.000 0 0 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 165.1 0.00 0.00 1 0.000 0 0 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 165.1 0.00 0.00 1 0.000 0 0 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:07:38.645 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative compaction: 0.00 GB write, 25.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval compaction: 0.00 GB write, 25.99 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: L0 2/0 79.52 KB 0.5 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 165.1 0.00 0.00 1 0.000 0 0 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: Sum 2/0 79.52 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 165.1 0.00 0.00 1 0.000 0 0 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-25T05:07:38.646 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 165.1 0.00 0.00 1 0.000 0 0 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative compaction: 0.00 GB write, 25.69 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:07:38.647 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: starting mon.a rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???) e1 preinit fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???).mds e1 new map 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???).mds e1 print_map 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: e1 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: legacy client fscid: -1 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout: No filesystems configured 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???).osd e1 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???).osd e1 crush map has features 288514050185494528, adjusting msgr requires 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a@-1(???).paxosservice(auth 1..2) refresh upgraded, format 0 -> 3 2024-05-25T05:07:38.648 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expand map: {default=false} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta from 'false' to 'false' 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expanded map: {default=false} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expand map: {default=info} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta from 'info' to 'info' 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expanded map: {default=info} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expand map: {default=daemon} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta from 'daemon' to 'daemon' 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expanded map: {default=daemon} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expand map: {default=debug} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta from 'debug' to 'debug' 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: expand_channel_meta expanded map: {default=debug} 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 bash[24718]: 8b3757c39634a35c544ec2b4d6956dc953c8bd86c99cdf506aaff6e57b5b78f6 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 systemd[1]: Started Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:07:38.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mon.a is new leader, mons a in quorum (ranks 0) 2024-05-25T05:07:38.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: monmap e1: 1 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0]} 2024-05-25T05:07:38.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: fsmap 2024-05-25T05:07:38.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: osdmap e1: 0 total, 0 up, 0 in 2024-05-25T05:07:38.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:38 smithi088 ceph-mon[24736]: mgrmap e1: no daemons active 2024-05-25T05:07:40.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:40 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1439461003' entity='client.admin' 2024-05-25T05:07:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:Wrote config to /etc/ceph/ceph.conf 2024-05-25T05:07:41.068 INFO:teuthology.orchestra.run.smithi088.stderr:Wrote keyring to /etc/ceph/ceph.client.admin.keyring 2024-05-25T05:07:41.069 INFO:teuthology.orchestra.run.smithi088.stderr:Creating mgr... 2024-05-25T05:07:41.069 INFO:teuthology.orchestra.run.smithi088.stderr:Verifying port 9283 ... 2024-05-25T05:07:41.378 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Failed to reset failed state of unit ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service: Unit ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service not loaded. 2024-05-25T05:07:41.385 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: Created symlink /etc/systemd/system/ceph-9a885618-1a54-11ef-bc9b-c7b262605968.target.wants/ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service → /etc/systemd/system/ceph-9a885618-1a54-11ef-bc9b-c7b262605968@.service. 2024-05-25T05:07:41.789 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:41 smithi088 systemd[1]: Starting Ceph mgr.y for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:07:42.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:41 smithi088 podman[24949]: 2024-05-25 05:07:41.69056426 +0000 UTC m=+0.017615346 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph:v17.2.0 2024-05-25T05:07:42.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:41 smithi088 podman[24949]: 2024-05-25 05:07:41.796527241 +0000 UTC m=+0.123578321 container create a93f9f434c45fa2433ad6bdca5ab8bacad0f528ec7abebb8abe4170e3918412b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, RELEASE=HEAD, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, version=8, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, io.openshift.tags=base centos centos-stream, release=754, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, name=centos-stream) 2024-05-25T05:07:42.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:41 smithi088 podman[24949]: 2024-05-25 05:07:41.990231746 +0000 UTC m=+0.317282806 container init a93f9f434c45fa2433ad6bdca5ab8bacad0f528ec7abebb8abe4170e3918412b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, vcs-type=git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, version=8, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., ceph=True) 2024-05-25T05:07:42.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:41 smithi088 podman[24949]: 2024-05-25 05:07:41.99297576 +0000 UTC m=+0.320026821 container start a93f9f434c45fa2433ad6bdca5ab8bacad0f528ec7abebb8abe4170e3918412b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, name=centos-stream, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, ceph=True, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, io.openshift.expose-services=, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public) 2024-05-25T05:07:42.111 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: disabled 2024-05-25T05:07:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: inactive 2024-05-25T05:07:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:firewalld.service is not enabled 2024-05-25T05:07:42.119 INFO:teuthology.orchestra.run.smithi088.stderr:Not possible to enable service . firewalld.service is not available 2024-05-25T05:07:42.127 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: disabled 2024-05-25T05:07:42.135 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: inactive 2024-05-25T05:07:42.136 INFO:teuthology.orchestra.run.smithi088.stderr:firewalld.service is not enabled 2024-05-25T05:07:42.136 INFO:teuthology.orchestra.run.smithi088.stderr:Not possible to open ports <[9283]>. firewalld.service is not available 2024-05-25T05:07:42.136 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for mgr to start... 2024-05-25T05:07:42.136 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for mgr... 2024-05-25T05:07:42.368 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:42 smithi088 bash[24949]: a93f9f434c45fa2433ad6bdca5ab8bacad0f528ec7abebb8abe4170e3918412b 2024-05-25T05:07:42.368 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:42 smithi088 systemd[1]: Started Ceph mgr.y for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:07:42.368 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:42.135+0000 7f99d7d61000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:07:42.368 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:42.268+0000 7f99d7d61000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:07:42.368 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:42.367+0000 7f99d7d61000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:07:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:07:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsid": "9a885618-1a54-11ef-bc9b-c7b262605968", 2024-05-25T05:07:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "health": { 2024-05-25T05:07:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-25T05:07:42.672 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "checks": {}, 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mutes": [] 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum": [ 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 0 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "a" 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_age": 4, 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "monmap": { 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-25T05:07:42.673 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-25T05:07:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osdmap": { 2024-05-25T05:07:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-25T05:07:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-25T05:07:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-25T05:07:42.674 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-25T05:07:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-25T05:07:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-25T05:07:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgmap": { 2024-05-25T05:07:42.677 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsmap": { 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:42.678 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "available": false, 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modules": [ 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "iostat", 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "nfs", 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "restful" 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "servicemap": { 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modified": "2024-05-25T05:07:29.070668+0000", 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:42.679 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:42.680 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-25T05:07:42.680 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:07:42.946 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:42 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2535284889' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-25T05:07:42.946 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:42.688+0000 7f99d7d61000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:07:42.946 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:42.772+0000 7f99d7d61000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:07:43.224 INFO:teuthology.orchestra.run.smithi088.stderr:mgr not available, waiting (1/15)... 2024-05-25T05:07:44.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:43.894+0000 7f99d7d61000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:07:44.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:44.054+0000 7f99d7d61000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:07:44.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:44.134+0000 7f99d7d61000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:07:44.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:44.440+0000 7f99d7d61000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:07:44.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:44.528+0000 7f99d7d61000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:07:44.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:44.618+0000 7f99d7d61000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:07:45.291 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:44.852+0000 7f99d7d61000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:07:45.541 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:45.291+0000 7f99d7d61000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsid": "9a885618-1a54-11ef-bc9b-c7b262605968", 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "health": { 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "checks": {}, 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mutes": [] 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-25T05:07:45.752 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum": [ 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 0 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "a" 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_age": 7, 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "monmap": { 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osdmap": { 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-25T05:07:45.753 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgmap": { 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-25T05:07:45.754 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsmap": { 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "available": false, 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modules": [ 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "iostat", 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "nfs", 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "restful" 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "servicemap": { 2024-05-25T05:07:45.755 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modified": "2024-05-25T05:07:29.070668+0000", 2024-05-25T05:07:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-25T05:07:45.756 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:07:46.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:45 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3456704860' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-25T05:07:46.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:45.810+0000 7f99d7d61000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:07:46.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:45.906+0000 7f99d7d61000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:07:46.247 INFO:teuthology.orchestra.run.smithi088.stderr:mgr not available, waiting (2/15)... 2024-05-25T05:07:46.502 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:46.208+0000 7f99d7d61000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:07:46.502 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:46.300+0000 7f99d7d61000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:07:46.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:46.715+0000 7f99d7d61000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:07:47.139 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:46.845+0000 7f99d7d61000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:07:47.139 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:46.937+0000 7f99d7d61000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:07:47.139 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:47.050+0000 7f99d7d61000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:07:47.139 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:47.139+0000 7f99d7d61000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:07:48.038 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:47.683+0000 7f99d7d61000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:07:48.039 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:48 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:48.039+0000 7f99d7d61000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:07:48.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: Activating manager daemon y 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: mgrmap e2: y(active, starting, since 0.00261978s) 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: Manager daemon y is now available 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' 2024-05-25T05:07:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:48 smithi088 ceph-mon[24736]: from='mgr.14100 172.21.15.88:0/735957111' entity='mgr.y' 2024-05-25T05:07:48.759 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsid": "9a885618-1a54-11ef-bc9b-c7b262605968", 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "health": { 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "checks": {}, 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mutes": [] 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum": [ 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 0 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "a" 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:48.760 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_age": 10, 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "monmap": { 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osdmap": { 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-25T05:07:48.761 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-25T05:07:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-25T05:07:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-25T05:07:48.764 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgmap": { 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsmap": { 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-25T05:07:48.765 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "available": false, 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modules": [ 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "iostat", 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "nfs", 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "restful" 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "servicemap": { 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:48.766 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modified": "2024-05-25T05:07:29.070668+0000", 2024-05-25T05:07:48.767 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:48.767 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:48.767 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-25T05:07:48.767 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:07:49.360 INFO:teuthology.orchestra.run.smithi088.stderr:mgr not available, waiting (3/15)... 2024-05-25T05:07:49.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:49 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3616796089' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-25T05:07:49.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:49 smithi088 ceph-mon[24736]: mgrmap e3: y(active, since 1.00578s) 2024-05-25T05:07:51.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:51 smithi088 ceph-mon[24736]: mgrmap e4: y(active, since 2s) 2024-05-25T05:07:52.081 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:52.081 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:07:52.081 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsid": "9a885618-1a54-11ef-bc9b-c7b262605968", 2024-05-25T05:07:52.081 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "health": { 2024-05-25T05:07:52.082 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "status": "HEALTH_OK", 2024-05-25T05:07:52.082 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "checks": {}, 2024-05-25T05:07:52.082 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mutes": [] 2024-05-25T05:07:52.082 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:52.082 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "election_epoch": 5, 2024-05-25T05:07:52.082 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum": [ 2024-05-25T05:07:52.086 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 0 2024-05-25T05:07:52.086 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_names": [ 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "a" 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "quorum_age": 13, 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "monmap": { 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "min_mon_release_name": "quincy", 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_mons": 1 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osdmap": { 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_osds": 0, 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_up_osds": 0, 2024-05-25T05:07:52.087 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_up_since": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_in_osds": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "osd_in_since": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_remapped_pgs": 0 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgmap": { 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "pgs_by_state": [], 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pgs": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_pools": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_objects": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "data_bytes": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_used": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_avail": 0, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "bytes_total": 0 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:52.088 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "fsmap": { 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "by_rank": [], 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "up:standby": 0 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mgrmap": { 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "available": true, 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_standbys": 0, 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modules": [ 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "iostat", 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "nfs", 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "restful" 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ], 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:52.089 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:52.090 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "servicemap": { 2024-05-25T05:07:52.090 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 1, 2024-05-25T05:07:52.090 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "modified": "2024-05-25T05:07:29.070668+0000", 2024-05-25T05:07:52.090 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "services": {} 2024-05-25T05:07:52.090 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: }, 2024-05-25T05:07:52.090 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "progress_events": {} 2024-05-25T05:07:52.090 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:07:52.692 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:52 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3590954923' entity='client.admin' cmd=[{"prefix": "status", "format": "json-pretty"}]: dispatch 2024-05-25T05:07:52.695 INFO:teuthology.orchestra.run.smithi088.stderr:mgr is available 2024-05-25T05:07:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: [global] 2024-05-25T05:07:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: fsid = 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:07:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon_osd_allow_pg_remap = true 2024-05-25T05:07:53.278 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon_osd_allow_primary_affinity = true 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mon_warn_on_no_sortbitwise = false 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: osd_crush_chooseleaf_type = 0 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: [mgr] 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: mgr/telemetry/nag = false 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: [osd] 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: osd_map_max_advance = 10 2024-05-25T05:07:53.279 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: osd_sloppy_crc = true 2024-05-25T05:07:53.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:53 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2831692214' entity='client.admin' cmd=[{"prefix": "config assimilate-conf"}]: dispatch 2024-05-25T05:07:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:53 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2831692214' entity='client.admin' cmd='[{"prefix": "config assimilate-conf"}]': finished 2024-05-25T05:07:53.852 INFO:teuthology.orchestra.run.smithi088.stderr:Enabling cephadm module... 2024-05-25T05:07:54.844 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:54 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3651586839' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "cephadm"}]: dispatch 2024-05-25T05:07:54.844 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setuser ceph since I am not root 2024-05-25T05:07:54.844 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setgroup ceph since I am not root 2024-05-25T05:07:54.844 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:54.713+0000 7f8b0b919000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:07:54.844 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:54.843+0000 7f8b0b919000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:07:55.147 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:54.942+0000 7f8b0b919000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:07:55.503 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:55.257+0000 7f8b0b919000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:07:55.503 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:55.340+0000 7f8b0b919000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:07:55.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:55 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3651586839' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "cephadm"}]': finished 2024-05-25T05:07:55.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:55 smithi088 ceph-mon[24736]: mgrmap e5: y(active, since 6s) 2024-05-25T05:07:55.869 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:07:55.869 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 5, 2024-05-25T05:07:55.869 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "available": true, 2024-05-25T05:07:55.869 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "active_name": "y", 2024-05-25T05:07:55.869 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_standby": 0 2024-05-25T05:07:55.869 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:07:56.424 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for the mgr to restart... 2024-05-25T05:07:56.425 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for mgr epoch 5... 2024-05-25T05:07:56.681 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:07:56 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/4251076163' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-25T05:07:56.682 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:56.479+0000 7f8b0b919000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:07:56.682 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:56.652+0000 7f8b0b919000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:07:57.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:56.739+0000 7f8b0b919000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:07:57.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:57.055+0000 7f8b0b919000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:07:57.390 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:57.146+0000 7f8b0b919000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:07:57.390 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:57.237+0000 7f8b0b919000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:07:57.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:57.473+0000 7f8b0b919000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:07:58.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:57.903+0000 7f8b0b919000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:07:58.760 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:58.379+0000 7f8b0b919000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:07:58.760 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:58.471+0000 7f8b0b919000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:07:58.760 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:58.759+0000 7f8b0b919000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:07:59.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:58.847+0000 7f8b0b919000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:07:59.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:59.241+0000 7f8b0b919000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:07:59.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:59.370+0000 7f8b0b919000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:07:59.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:59.461+0000 7f8b0b919000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:08:00.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:59.573+0000 7f8b0b919000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:08:00.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:07:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:07:59.660+0000 7f8b0b919000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:08:00.551 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:00 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:00.197+0000 7f8b0b919000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:08:00.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:00 smithi088 ceph-mon[24736]: Active manager daemon y restarted 2024-05-25T05:08:00.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:00 smithi088 ceph-mon[24736]: Activating manager daemon y 2024-05-25T05:08:00.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:00 smithi088 ceph-mon[24736]: osdmap e2: 0 total, 0 up, 0 in 2024-05-25T05:08:00.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:00 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:00.550+0000 7f8b0b919000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:08:01.620 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:08:01.620 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mgrmap_epoch": 7, 2024-05-25T05:08:01.620 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "initialized": true 2024-05-25T05:08:01.620 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:08:01.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:08:01] ENGINE Bus STARTING 2024-05-25T05:08:01.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:08:01] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:08:01.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:08:01] ENGINE Bus STARTED 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: mgrmap e6: y(active, starting, since 0.0528962s) 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: Manager daemon y is now available 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:01.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:01.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:01.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:01.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:08:01.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:08:01.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:01 smithi088 ceph-mon[24736]: [25/May/2024:05:08:01] ENGINE Bus STARTING 2024-05-25T05:08:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:mgr epoch 5 is available 2024-05-25T05:08:02.200 INFO:teuthology.orchestra.run.smithi088.stderr:Setting orchestrator backend to cephadm... 2024-05-25T05:08:02.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:02 smithi088 ceph-mon[24736]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-25T05:08:02.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:02 smithi088 ceph-mon[24736]: mgrmap e7: y(active, since 1.06049s) 2024-05-25T05:08:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:02 smithi088 ceph-mon[24736]: from='client.14124 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-25T05:08:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:02 smithi088 ceph-mon[24736]: [25/May/2024:05:08:01] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:08:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:02 smithi088 ceph-mon[24736]: [25/May/2024:05:08:01] ENGINE Bus STARTED 2024-05-25T05:08:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:02 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:02 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:04.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:03 smithi088 ceph-mon[24736]: mgrmap e8: y(active, since 2s) 2024-05-25T05:08:04.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:03 smithi088 ceph-mon[24736]: from='client.14132 -' entity='client.admin' cmd=[{"prefix": "orch set backend", "module_name": "cephadm", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:04.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:03 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:04.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:03 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:04.040 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: value unchanged 2024-05-25T05:08:04.598 INFO:teuthology.orchestra.run.smithi088.stderr:Generating ssh key... 2024-05-25T05:08:04.899 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:04 smithi088 ceph-mon[24736]: from='client.14134 -' entity='client.admin' cmd=[{"prefix": "cephadm set-user", "user": "root", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: Generating public/private rsa key pair. 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: Your identification has been saved in /tmp/tmpymjhft29/key. 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: Your public key has been saved in /tmp/tmpymjhft29/key.pub. 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: The key fingerprint is: 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: SHA256:q5k0m5dDULxoQSmwcwEJscdADs92YTdhk5focatX9Hk ceph-9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: The key's randomart image is: 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: +---[RSA 3072]----+ 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: |*+o++.B* . | 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: |o*.o.=*o* . | 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: |..O oo B + . . | 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: | o + = o . o E | 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: | . oS. . | 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: | . o. | 2024-05-25T05:08:05.805 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: | oo.. | 2024-05-25T05:08:05.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: | . B+ | 2024-05-25T05:08:05.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: | *. . | 2024-05-25T05:08:05.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: +----[SHA256]-----+ 2024-05-25T05:08:06.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:06 smithi088 ceph-mon[24736]: from='client.14136 -' entity='client.admin' cmd=[{"prefix": "cephadm generate-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:06.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:06 smithi088 ceph-mon[24736]: Generating ssh key... 2024-05-25T05:08:06.617 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:06 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:06.618 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:06 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:06.618 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtLTUFf1dKLjZXYQMEPqrWqoo7OXwliqWKs2CQrd/QDbiTTpW7vPfJniiaP0F28B4qxZJwU9mBYqzq+4TrZc+9R9w6sQzuAhAkf9PY/6JPJsSQmEg8Rf3RQAQNGBb1F4BSESX1jVzOOKEsEk/BmLZ6ErO7/DFwblL4NxPQtTpukv6e5wSXyP6ynHKqV69ctVNO3RqDYEMTWpAGKJUyykIWQpNlk1rjuZbL2Hi0GaD29gHhOF7ZOayWwZq7PMhBQPWWF6koarhPLAA7u+GaVKgGTD0QSRruwlB5qY9IzNK4S0nPgYnu1uAd7woc2bPs2nLKUq8LomT5dyXtnlTO0CDEZDpxPcaq2Gzv+oNsoxGZ2JzrDAsRTEpTtGeoFVtYBJPc+Mgxr0Un0h/mxrXsGOSLTHokB1HhifYxftXaoS3i78uSNcTNd5fvoV3araVcuGD3X4Joq8j0dVfi2VPiZ7mB0nmatmp/pS8wdbrJC28Wi7QOdHNaYiHCNuxnC12RTqU= ceph-9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:08:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:Wrote public SSH key to /home/ubuntu/cephtest/ceph.pub 2024-05-25T05:08:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:Adding key to root@localhost authorized_keys... 2024-05-25T05:08:07.214 INFO:teuthology.orchestra.run.smithi088.stderr:Adding host smithi088... 2024-05-25T05:08:07.798 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:07 smithi088 ceph-mon[24736]: from='client.14138 -' entity='client.admin' cmd=[{"prefix": "cephadm get-pub-key", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:08.675 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: Added host 'smithi088' with addr '172.21.15.88' 2024-05-25T05:08:09.270 INFO:teuthology.orchestra.run.smithi088.stderr:Deploying unmanaged mon service... 2024-05-25T05:08:09.521 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:09 smithi088 ceph-mon[24736]: from='client.14140 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi088", "addr": "172.21.15.88", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:09.521 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:09 smithi088 ceph-mon[24736]: Deploying cephadm binary to smithi088 2024-05-25T05:08:09.521 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:09 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:09.522 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:09 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:09.994 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: Scheduled mon update... 2024-05-25T05:08:10.645 INFO:teuthology.orchestra.run.smithi088.stderr:Deploying unmanaged mgr service... 2024-05-25T05:08:10.769 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:10 smithi088 ceph-mon[24736]: Added host smithi088 2024-05-25T05:08:10.769 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:10 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:11.372 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: Scheduled mgr update... 2024-05-25T05:08:11.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:11 smithi088 ceph-mon[24736]: from='client.14142 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:11.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:11 smithi088 ceph-mon[24736]: Saving service mon spec with placement count:5 2024-05-25T05:08:11.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:11 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:12.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:12 smithi088 ceph-mon[24736]: from='client.14144 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "unmanaged": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:12.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:12 smithi088 ceph-mon[24736]: Saving service mgr spec with placement count:2 2024-05-25T05:08:12.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:12 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:14.200 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:13 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:14.201 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:13 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1155507321' entity='client.admin' 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: from='mgr.14120 172.21.15.88:0/1151224091' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]': finished 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: Deploying daemon agent.smithi088 on smithi088 2024-05-25T05:08:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:15 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/635547221' entity='client.admin' 2024-05-25T05:08:15.813 INFO:teuthology.orchestra.run.smithi088.stderr:Enabling the dashboard module... 2024-05-25T05:08:16.876 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:16 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3666805414' entity='client.admin' cmd=[{"prefix": "mgr module enable", "module": "dashboard"}]: dispatch 2024-05-25T05:08:16.876 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setuser ceph since I am not root 2024-05-25T05:08:16.877 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setgroup ceph since I am not root 2024-05-25T05:08:16.877 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:16.745+0000 7f1b71e03000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:08:16.877 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:16.875+0000 7f1b71e03000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:08:17.250 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:16.974+0000 7f1b71e03000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:08:17.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:17 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:17.283+0000 7f1b71e03000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:08:17.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:17 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:17.366+0000 7f1b71e03000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:08:17.967 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:17 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3666805414' entity='client.admin' cmd='[{"prefix": "mgr module enable", "module": "dashboard"}]': finished 2024-05-25T05:08:17.967 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:17 smithi088 ceph-mon[24736]: mgrmap e9: y(active, since 16s) 2024-05-25T05:08:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:08:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "epoch": 9, 2024-05-25T05:08:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "available": true, 2024-05-25T05:08:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "active_name": "y", 2024-05-25T05:08:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "num_standby": 0 2024-05-25T05:08:17.968 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:08:18.592 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:18 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:18.518+0000 7f1b71e03000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:08:18.659 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for the mgr to restart... 2024-05-25T05:08:18.660 INFO:teuthology.orchestra.run.smithi088.stderr:Waiting for mgr epoch 9... 2024-05-25T05:08:18.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:18 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/854147802' entity='client.admin' cmd=[{"prefix": "mgr stat"}]: dispatch 2024-05-25T05:08:18.942 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:18 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:18.686+0000 7f1b71e03000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:08:18.942 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:18 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:18.770+0000 7f1b71e03000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:08:19.273 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:19.087+0000 7f1b71e03000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:08:19.273 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:19.180+0000 7f1b71e03000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:08:19.273 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:19.273+0000 7f1b71e03000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:08:19.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:19.511+0000 7f1b71e03000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:08:20.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:19.945+0000 7f1b71e03000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:08:20.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:20.428+0000 7f1b71e03000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:08:20.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:20.521+0000 7f1b71e03000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:08:21.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:20.809+0000 7f1b71e03000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:08:21.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:20.898+0000 7f1b71e03000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:08:21.659 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:21.321+0000 7f1b71e03000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:08:21.659 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:21.454+0000 7f1b71e03000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:08:21.659 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:21.546+0000 7f1b71e03000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:08:21.659 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:21.659+0000 7f1b71e03000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:08:22.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:21.749+0000 7f1b71e03000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:08:22.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:22.285+0000 7f1b71e03000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:08:23.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:08:22.663+0000 7f1b71e03000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:08:23.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:08:23] ENGINE Bus STARTING 2024-05-25T05:08:23.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:08:23] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:08:23.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:08:23] ENGINE Bus STARTED 2024-05-25T05:08:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: { 2024-05-25T05:08:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "mgrmap_epoch": 11, 2024-05-25T05:08:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: "initialized": true 2024-05-25T05:08:23.729 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: } 2024-05-25T05:08:24.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: Active manager daemon y restarted 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: Activating manager daemon y 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: osdmap e3: 0 total, 0 up, 0 in 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: mgrmap e10: y(active, starting, since 0.0550736s) 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:08:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:08:24.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: Manager daemon y is now available 2024-05-25T05:08:24.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:24.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:24.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:24.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:08:24.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:08:24.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: [25/May/2024:05:08:23] ENGINE Bus STARTING 2024-05-25T05:08:24.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: [25/May/2024:05:08:23] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:08:24.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: [25/May/2024:05:08:23] ENGINE Bus STARTED 2024-05-25T05:08:24.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:24.494 INFO:teuthology.orchestra.run.smithi088.stderr:mgr epoch 9 is available 2024-05-25T05:08:24.495 INFO:teuthology.orchestra.run.smithi088.stderr:Generating a dashboard self-signed certificate... 2024-05-25T05:08:24.746 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:24 smithi088 ceph-mon[24736]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "get_command_descriptions"}]: dispatch 2024-05-25T05:08:24.746 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:24 smithi088 ceph-mon[24736]: mgrmap e11: y(active, since 1.0577s) 2024-05-25T05:08:24.746 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:24 smithi088 ceph-mon[24736]: from='client.14156 -' entity='client.admin' cmd=[{"prefix": "mgr_status"}]: dispatch 2024-05-25T05:08:25.246 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: Self-signed certificate created 2024-05-25T05:08:25.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: mgrmap e12: y(active, since 2s) 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: from='client.14164 -' entity='client.admin' cmd=[{"prefix": "dashboard create-self-signed-cert", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:25 smithi088 ceph-mon[24736]: Deploying daemon agent.smithi088 on smithi088 2024-05-25T05:08:25.859 INFO:teuthology.orchestra.run.smithi088.stderr:Creating initial admin user... 2024-05-25T05:08:26.762 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: {"username": "admin", "password": "$2b$12$gnroGNhnAWRUoLv165n6rO.TMhRudjEepl3LxgRVdOwcvG5JUdlbW", "roles": ["administrator"], "name": null, "email": null, "lastUpdate": 1716613706, "enabled": true, "pwdExpirationDate": null, "pwdUpdateRequired": true} 2024-05-25T05:08:27.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:26 smithi088 ceph-mon[24736]: from='client.14166 -' entity='client.admin' cmd=[{"prefix": "dashboard ac-user-create", "username": "admin", "rolename": "administrator", "force_password": true, "pwd_update_required": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:27.374 INFO:teuthology.orchestra.run.smithi088.stderr:Fetching dashboard port number... 2024-05-25T05:08:27.996 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:27 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:27.997 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: 8443 2024-05-25T05:08:28.682 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: disabled 2024-05-25T05:08:28.689 INFO:teuthology.orchestra.run.smithi088.stderr:systemctl: inactive 2024-05-25T05:08:28.689 INFO:teuthology.orchestra.run.smithi088.stderr:firewalld.service is not enabled 2024-05-25T05:08:28.690 INFO:teuthology.orchestra.run.smithi088.stderr:Not possible to open ports <[8443]>. firewalld.service is not available 2024-05-25T05:08:28.692 INFO:teuthology.orchestra.run.smithi088.stderr:Ceph Dashboard is now available at: 2024-05-25T05:08:28.692 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:28.692 INFO:teuthology.orchestra.run.smithi088.stderr: URL: https://smithi088.front.sepia.ceph.com:8443/ 2024-05-25T05:08:28.692 INFO:teuthology.orchestra.run.smithi088.stderr: User: admin 2024-05-25T05:08:28.692 INFO:teuthology.orchestra.run.smithi088.stderr: Password: 8d3nomeq7t 2024-05-25T05:08:28.692 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:28.692 INFO:teuthology.orchestra.run.smithi088.stderr:Enabling autotune for osd_memory_target 2024-05-25T05:08:28.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:28 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2909480493' entity='client.admin' cmd=[{"prefix": "config get", "who": "mgr", "key": "mgr/dashboard/ssl_server_port"}]: dispatch 2024-05-25T05:08:30.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:30 smithi088 ceph-mon[24736]: mgrmap e13: y(active, since 6s) 2024-05-25T05:08:30.768 INFO:teuthology.orchestra.run.smithi088.stderr:/usr/bin/ceph: set mgr/dashboard/cluster/status 2024-05-25T05:08:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:You can access the Ceph CLI with: 2024-05-25T05:08:31.429 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:31.429 INFO:teuthology.orchestra.run.smithi088.stderr: sudo /home/ubuntu/cephtest/cephadm shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring 2024-05-25T05:08:31.429 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:31.429 INFO:teuthology.orchestra.run.smithi088.stderr:Please consider enabling telemetry to help improve Ceph: 2024-05-25T05:08:31.429 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:31.430 INFO:teuthology.orchestra.run.smithi088.stderr: ceph telemetry on 2024-05-25T05:08:31.430 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:For more information see: 2024-05-25T05:08:31.430 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:31.430 INFO:teuthology.orchestra.run.smithi088.stderr: https://docs.ceph.com/docs/master/mgr/telemetry/ 2024-05-25T05:08:31.430 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:08:31.430 INFO:teuthology.orchestra.run.smithi088.stderr:Bootstrap complete. 2024-05-25T05:08:31.465 INFO:tasks.cephadm:Fetching config... 2024-05-25T05:08:31.465 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:08:31.465 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.conf of=/dev/stdout 2024-05-25T05:08:31.480 INFO:tasks.cephadm:Fetching client.admin keyring... 2024-05-25T05:08:31.481 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:08:31.481 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/etc/ceph/ceph.client.admin.keyring of=/dev/stdout 2024-05-25T05:08:31.539 INFO:tasks.cephadm:Fetching mon keyring... 2024-05-25T05:08:31.539 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:08:31.539 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/keyring of=/dev/stdout 2024-05-25T05:08:31.625 INFO:tasks.cephadm:Fetching pub ssh key... 2024-05-25T05:08:31.625 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:08:31.625 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/home/ubuntu/cephtest/ceph.pub of=/dev/stdout 2024-05-25T05:08:31.687 INFO:tasks.cephadm:Installing pub ssh key for root users... 2024-05-25T05:08:31.687 DEBUG:teuthology.orchestra.run.smithi088:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtLTUFf1dKLjZXYQMEPqrWqoo7OXwliqWKs2CQrd/QDbiTTpW7vPfJniiaP0F28B4qxZJwU9mBYqzq+4TrZc+9R9w6sQzuAhAkf9PY/6JPJsSQmEg8Rf3RQAQNGBb1F4BSESX1jVzOOKEsEk/BmLZ6ErO7/DFwblL4NxPQtTpukv6e5wSXyP6ynHKqV69ctVNO3RqDYEMTWpAGKJUyykIWQpNlk1rjuZbL2Hi0GaD29gHhOF7ZOayWwZq7PMhBQPWWF6koarhPLAA7u+GaVKgGTD0QSRruwlB5qY9IzNK4S0nPgYnu1uAd7woc2bPs2nLKUq8LomT5dyXtnlTO0CDEZDpxPcaq2Gzv+oNsoxGZ2JzrDAsRTEpTtGeoFVtYBJPc+Mgxr0Un0h/mxrXsGOSLTHokB1HhifYxftXaoS3i78uSNcTNd5fvoV3araVcuGD3X4Joq8j0dVfi2VPiZ7mB0nmatmp/pS8wdbrJC28Wi7QOdHNaYiHCNuxnC12RTqU= ceph-9a885618-1a54-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-25T05:08:31.816 INFO:teuthology.orchestra.run.smithi088.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtLTUFf1dKLjZXYQMEPqrWqoo7OXwliqWKs2CQrd/QDbiTTpW7vPfJniiaP0F28B4qxZJwU9mBYqzq+4TrZc+9R9w6sQzuAhAkf9PY/6JPJsSQmEg8Rf3RQAQNGBb1F4BSESX1jVzOOKEsEk/BmLZ6ErO7/DFwblL4NxPQtTpukv6e5wSXyP6ynHKqV69ctVNO3RqDYEMTWpAGKJUyykIWQpNlk1rjuZbL2Hi0GaD29gHhOF7ZOayWwZq7PMhBQPWWF6koarhPLAA7u+GaVKgGTD0QSRruwlB5qY9IzNK4S0nPgYnu1uAd7woc2bPs2nLKUq8LomT5dyXtnlTO0CDEZDpxPcaq2Gzv+oNsoxGZ2JzrDAsRTEpTtGeoFVtYBJPc+Mgxr0Un0h/mxrXsGOSLTHokB1HhifYxftXaoS3i78uSNcTNd5fvoV3araVcuGD3X4Joq8j0dVfi2VPiZ7mB0nmatmp/pS8wdbrJC28Wi7QOdHNaYiHCNuxnC12RTqU= ceph-9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:08:31.828 DEBUG:teuthology.orchestra.run.smithi136:> sudo install -d -m 0700 /root/.ssh && echo 'ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtLTUFf1dKLjZXYQMEPqrWqoo7OXwliqWKs2CQrd/QDbiTTpW7vPfJniiaP0F28B4qxZJwU9mBYqzq+4TrZc+9R9w6sQzuAhAkf9PY/6JPJsSQmEg8Rf3RQAQNGBb1F4BSESX1jVzOOKEsEk/BmLZ6ErO7/DFwblL4NxPQtTpukv6e5wSXyP6ynHKqV69ctVNO3RqDYEMTWpAGKJUyykIWQpNlk1rjuZbL2Hi0GaD29gHhOF7ZOayWwZq7PMhBQPWWF6koarhPLAA7u+GaVKgGTD0QSRruwlB5qY9IzNK4S0nPgYnu1uAd7woc2bPs2nLKUq8LomT5dyXtnlTO0CDEZDpxPcaq2Gzv+oNsoxGZ2JzrDAsRTEpTtGeoFVtYBJPc+Mgxr0Un0h/mxrXsGOSLTHokB1HhifYxftXaoS3i78uSNcTNd5fvoV3araVcuGD3X4Joq8j0dVfi2VPiZ7mB0nmatmp/pS8wdbrJC28Wi7QOdHNaYiHCNuxnC12RTqU= ceph-9a885618-1a54-11ef-bc9b-c7b262605968' | sudo tee -a /root/.ssh/authorized_keys && sudo chmod 0600 /root/.ssh/authorized_keys 2024-05-25T05:08:31.871 INFO:teuthology.orchestra.run.smithi136.stdout:ssh-rsa AAAAB3NzaC1yc2EAAAADAQABAAABgQDtLTUFf1dKLjZXYQMEPqrWqoo7OXwliqWKs2CQrd/QDbiTTpW7vPfJniiaP0F28B4qxZJwU9mBYqzq+4TrZc+9R9w6sQzuAhAkf9PY/6JPJsSQmEg8Rf3RQAQNGBb1F4BSESX1jVzOOKEsEk/BmLZ6ErO7/DFwblL4NxPQtTpukv6e5wSXyP6ynHKqV69ctVNO3RqDYEMTWpAGKJUyykIWQpNlk1rjuZbL2Hi0GaD29gHhOF7ZOayWwZq7PMhBQPWWF6koarhPLAA7u+GaVKgGTD0QSRruwlB5qY9IzNK4S0nPgYnu1uAd7woc2bPs2nLKUq8LomT5dyXtnlTO0CDEZDpxPcaq2Gzv+oNsoxGZ2JzrDAsRTEpTtGeoFVtYBJPc+Mgxr0Un0h/mxrXsGOSLTHokB1HhifYxftXaoS3i78uSNcTNd5fvoV3araVcuGD3X4Joq8j0dVfi2VPiZ7mB0nmatmp/pS8wdbrJC28Wi7QOdHNaYiHCNuxnC12RTqU= ceph-9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:08:31.883 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph config set mgr mgr/cephadm/allow_ptrace true 2024-05-25T05:08:31.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:31 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2502378468' entity='client.admin' 2024-05-25T05:08:32.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:32 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:08:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:08:33.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:33.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:33.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:33.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:33.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:33.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:33.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:35.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:34 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3736596880' entity='client.admin' 2024-05-25T05:08:35.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:34 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:35.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:34 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:35.203 INFO:tasks.cephadm:Distributing conf and client.admin keyring to all hosts + 0755 2024-05-25T05:08:35.203 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch client-keyring set client.admin '*' --mode 0755 2024-05-25T05:08:38.214 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:08:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:08:38.867 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:08:38] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:08:39.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:39.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:39.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:39.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:39.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:39.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:08:39.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:08:39.301 INFO:tasks.cephadm:Writing (initial) conf and keyring to smithi136 2024-05-25T05:08:39.301 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-25T05:08:39.301 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.conf 2024-05-25T05:08:39.320 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-25T05:08:39.320 DEBUG:teuthology.orchestra.run.smithi136:> dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:08:39.379 INFO:tasks.cephadm:Adding host smithi136 to orchestrator... 2024-05-25T05:08:39.379 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch host add smithi136 2024-05-25T05:08:40.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:40 smithi088 ceph-mon[24736]: from='client.14176 -' entity='client.admin' cmd=[{"prefix": "orch client-keyring set", "entity": "client.admin", "placement": "*", "mode": "0755", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:40.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:40 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:08:40.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:40 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:08:40.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:40.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:42.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:41 smithi088 ceph-mon[24736]: from='client.14178 -' entity='client.admin' cmd=[{"prefix": "orch host add", "hostname": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:42.296 INFO:teuthology.orchestra.run.smithi088.stdout:Added host 'smithi136' with addr '172.21.15.136' 2024-05-25T05:08:42.879 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch host ls --format=json 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: Deploying cephadm binary to smithi136 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: Added host smithi136 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:43.452 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:08:43.453 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:43.453 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:08:43.453 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]': finished 2024-05-25T05:08:44.664 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:44 smithi088 ceph-mon[24736]: pgmap v3: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:44.734 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:08:44.735 INFO:teuthology.orchestra.run.smithi088.stdout:[{"addr": "172.21.15.88", "hostname": "smithi088", "labels": [], "status": ""}, {"addr": "172.21.15.136", "hostname": "smithi136", "labels": [], "status": ""}] 2024-05-25T05:08:45.358 INFO:tasks.cephadm:Setting crush tunables to default 2024-05-25T05:08:45.359 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd crush tunables default 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: Deploying daemon agent.smithi136 on smithi136 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:08:45.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:45.955 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:08:45] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:08:46.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:08:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:08:46.767 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:46 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:08:46.767 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:46 smithi088 ceph-mon[24736]: pgmap v4: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:46.768 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:46 smithi088 ceph-mon[24736]: from='client.14180 -' entity='client.admin' cmd=[{"prefix": "orch host ls", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-25T05:08:46.768 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:46 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:46.768 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:46 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:46.768 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:46 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:47.517 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:08:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:08:47.523 INFO:teuthology.orchestra.run.smithi088.stderr:adjusted tunables profile to default 2024-05-25T05:08:47.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:47 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2425022063' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-25T05:08:47.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:47 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:47.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:47 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:48.196 INFO:tasks.cephadm:Adding mon.a on smithi088 2024-05-25T05:08:48.196 INFO:tasks.cephadm:Adding mon.c on smithi088 2024-05-25T05:08:48.197 INFO:tasks.cephadm:Adding mon.b on smithi136 2024-05-25T05:08:48.197 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch apply mon '3;smithi088:172.21.15.88=a;smithi088:[v2:172.21.15.88:3301,v1:172.21.15.88:6790]=c;smithi136:172.21.15.136=b' 2024-05-25T05:08:48.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:48 smithi088 ceph-mon[24736]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:48 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2425022063' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-25T05:08:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:48 smithi088 ceph-mon[24736]: osdmap e4: 0 total, 0 up, 0 in 2024-05-25T05:08:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:49.904 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mon update... 2024-05-25T05:08:50.371 DEBUG:teuthology.orchestra.run.smithi088:mon.c> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.c.service 2024-05-25T05:08:50.373 DEBUG:teuthology.orchestra.run.smithi136:mon.b> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.b.service 2024-05-25T05:08:50.375 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-25T05:08:50.376 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:08:50.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:08:51.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:51 smithi088 ceph-mon[24736]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi088:172.21.15.88=a;smithi088:[v2:172.21.15.88:3301,v1:172.21.15.88:6790]=c;smithi136:172.21.15.136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:08:51.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:51 smithi088 ceph-mon[24736]: Saving service mon spec with placement smithi088:172.21.15.88=a;smithi088:[v2:172.21.15.88:3301,v1:172.21.15.88:6790]=c;smithi136:172.21.15.136=b;count:3 2024-05-25T05:08:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:51 smithi088 ceph-mon[24736]: Deploying daemon mon.c on smithi088 2024-05-25T05:08:52.198 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T05:08:52.198 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":1,"fsid":"9a885618-1a54-11ef-bc9b-c7b262605968","modified":"2024-05-25T05:07:22.732162Z","created":"2024-05-25T05:07:22.732162Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0]} 2024-05-25T05:08:52.200 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 1 2024-05-25T05:08:52.804 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:52 smithi088 ceph-mon[24736]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:52.804 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:52 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/1497741003' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:08:53.702 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-25T05:08:53.703 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-05-25T05:08:58.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:08:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:08:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: mon.a calling monitor election 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: mon.c calling monitor election 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:08:58.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: monmap e2: 2 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: fsmap 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: osdmap e4: 0 total, 0 up, 0 in 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: mgrmap e13: y(active, since 35s) 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: overall HEALTH_OK 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:08:58 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:08:58.699 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T05:08:58.700 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":2,"fsid":"9a885618-1a54-11ef-bc9b-c7b262605968","modified":"2024-05-25T05:08:53.107680Z","created":"2024-05-25T05:07:22.732162Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3301","nonce":0},{"type":"v1","addr":"172.21.15.88:6790","nonce":0}]},"addr":"172.21.15.88:6790/0","public_addr":"172.21.15.88:6790/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1]} 2024-05-25T05:08:58.702 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 2 2024-05-25T05:08:59.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:59 smithi088 ceph-mon[24736]: Deploying daemon mon.b on smithi136 2024-05-25T05:08:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:59 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/1752512343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:08:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:08:59 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:08:59.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:08:59 smithi088 ceph-mon[29649]: Deploying daemon mon.b on smithi136 2024-05-25T05:08:59.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:08:59 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/1752512343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:08:59.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:08:59 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:00.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:00 smithi088 ceph-mon[24736]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:00 smithi088 ceph-mon[29649]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 podman[25599]: 2024-05-25 05:09:01.25643627 +0000 UTC m=+0.017823304 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:09:01.813 INFO:tasks.cephadm:Waiting for 3 mons in monmap... 2024-05-25T05:09:01.814 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph mon dump -f json 2024-05-25T05:09:01.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 podman[25599]: 2024-05-25 05:09:01.508600551 +0000 UTC m=+0.269987561 container init 5dae4d6e986be817525875820097edddff49a0297185e7cf1450700a3e8cee4f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git, vendor=Red Hat, Inc., ceph=True, version=8, GIT_CLEAN=True, name=centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, architecture=x86_64, com.redhat.component=centos-stream-container, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8) 2024-05-25T05:09:01.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 podman[25599]: 2024-05-25 05:09:01.511607952 +0000 UTC m=+0.272994963 container start 5dae4d6e986be817525875820097edddff49a0297185e7cf1450700a3e8cee4f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, release=754, architecture=x86_64, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, vcs-type=git, io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, version=8, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.expose-services=, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-05-25T05:09:01.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: set uid:gid to 167:167 (ceph:ceph) 2024-05-25T05:09:01.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable), process ceph-mon, pid 2 2024-05-25T05:09:01.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pidfile_write: ignore empty --pid-file 2024-05-25T05:09:01.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: load: jerasure load: lrc 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: RocksDB version: 6.15.5 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Git sha rocksdb_build_git_sha:@0@ 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Compile date Apr 18 2022 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: DB SUMMARY 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: DB Session ID: VQQ2S08UT47H4SG8DG9Z 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: CURRENT file: CURRENT 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: IDENTITY file: IDENTITY 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: MANIFEST file: MANIFEST-000003 size: 57 Bytes 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 0, files: 2024-05-25T05:09:01.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000004.log size: 636 ; 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.error_if_exists: 0 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.create_if_missing: 0 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.paranoid_checks: 1 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.env: 0x55b45b2c6860 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.fs: Posix File System 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.info_log: 0x55b45d781dc0 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_file_opening_threads: 16 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.statistics: (nil) 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.use_fsync: 0 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_log_file_size: 0 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-25T05:09:01.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.keep_log_file_num: 1000 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.recycle_log_file_num: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.allow_fallocate: 1 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.allow_mmap_reads: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.allow_mmap_writes: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.use_direct_reads: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.create_missing_column_families: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.db_log_dir: 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.wal_dir: /var/lib/ceph/mon/ceph-b/store.db 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-25T05:09:01.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.advise_random_on_open: 1 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.db_write_buffer_size: 0 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.write_buffer_manager: 0x55b45d872240 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.new_table_reader_for_compaction_inputs: 0 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-25T05:09:01.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.rate_limiter: (nil) 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.wal_recovery_mode: 2 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.enable_thread_tracking: 0 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.enable_pipelined_write: 0 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.unordered_write: 0 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.row_cache: None 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.wal_filter: None 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.allow_ingest_behind: 0 2024-05-25T05:09:01.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.preserve_deletes: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.two_write_queues: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.manual_wal_flush: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.atomic_flush: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.log_readahead_size: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.best_efforts_recovery: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.allow_data_in_errors: 0 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.db_host_id: __hostname__ 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_background_jobs: 2 2024-05-25T05:09:01.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_background_compactions: -1 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_subcompactions: 1 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_total_wal_size: 0 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_open_files: -1 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bytes_per_sync: 0 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_readahead_size: 0 2024-05-25T05:09:01.845 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_background_flushes: -1 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Compression algorithms supported: 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kZSTD supported: 0 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kXpressCompression supported: 0 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kLZ4HCCompression supported: 1 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kLZ4Compression supported: 1 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kBZip2Compression supported: 0 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kZlibCompression supported: 1 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: kSnappyCompression supported: 1 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/version_set.cc:4725] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/column_family.cc:597] --------------- Options for column family [default]: 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-25T05:09:01.846 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.merge_operator: 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_filter: None 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_filter_factory: None 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.sst_partitioner_factory: None 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55b45d74dd00) 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: cache_index_and_filter_blocks: 1 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: pin_top_level_index_and_filter: 1 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_type: 0 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: data_block_index_type: 0 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_shortening: 1 2024-05-25T05:09:01.847 INFO:journalctl@ceph.mon.b.smithi136.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: hash_index_allow_collision: 1 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: checksum: 1 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: no_block_cache: 0 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache: 0x55b45d7b8170 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_name: BinnedLRUCache 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_options: 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: capacity : 536870912 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: num_shard_bits : 4 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: strict_capacity_limit : 0 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: high_pri_pool_ratio: 0.000 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_compressed: (nil) 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: persistent_cache: (nil) 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_size: 4096 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_size_deviation: 10 2024-05-25T05:09:01.848 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_restart_interval: 16 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_block_restart_interval: 1 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: metadata_block_size: 4096 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: partition_filters: 0 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_delta_encoding: 1 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: filter_policy: rocksdb.BuiltinBloomFilter 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: whole_key_filtering: 1 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: verify_compression: 0 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: read_amp_bytes_per_bit: 0 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: format_version: 4 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: enable_index_compression: 1 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_align: 0 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.write_buffer_size: 33554432 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_write_buffer_number: 2 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression: NoCompression 2024-05-25T05:09:01.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression: Disabled 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.prefix_extractor: nullptr 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.num_levels: 7 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-25T05:09:01.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression_opts.level: 32767 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression_opts.strategy: 0 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compression_opts.enabled: false 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.target_file_size_base: 67108864 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-25T05:09:01.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.arena_block_size: 4194304 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.rate_limit_delay_max_milliseconds: 100 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.disable_auto_compactions: 0 2024-05-25T05:09:01.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.table_properties_collectors: 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.inplace_update_support: 0 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-25T05:09:01.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.bloom_locality: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.max_successive_merges: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.paranoid_file_checks: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.force_consistency_checks: 1 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.report_bg_io_stats: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.ttl: 2592000 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.enable_blob_files: false 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.min_blob_size: 0 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.blob_file_size: 268435456 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-25T05:09:01.854 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/version_set.cc:4773] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000003 succeeded,manifest_file_number is 3, next_file_number is 5, last_sequence is 0, log_number is 0,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/version_set.cc:4782] Column family [default] (ID 0), log number is 0 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/version_set.cc:4083] Creating manifest 7 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716613741537832, "job": 1, "event": "recovery_started", "wal_files": [4]} 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/db_impl/db_impl_open.cc:847] Recovering log #4 mode 2 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [table/block_based/filter_policy.cc:996] Using legacy Bloom filter with high (20) bits/key. Dramatic filter space and/or accuracy improvement is available with format_version>=5. 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716613741538127, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 8, "file_size": 1670, "file_checksum": "", "file_checksum_func_name": "Unknown", "table_properties": {"data_size": 648, "index_size": 31, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 69, "raw_key_size": 115, "raw_average_key_size": 23, "raw_value_size": 526, "raw_average_value_size": 105, "num_data_blocks": 1, "num_entries": 5, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "rocksdb.BuiltinBloomFilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; ", "creation_time": 1716613741, "oldest_key_time": 0, "file_creation_time": 0, "db_id": "7d58377b-4925-434a-ac06-39ee339a315a", "db_session_id": "VQQ2S08UT47H4SG8DG9Z"}} 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/version_set.cc:4083] Creating manifest 9 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716613741538460, "job": 1, "event": "recovery_finished"} 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [file/delete_scheduler.cc:73] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000004.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/db_impl/db_impl_open.cc:1701] SstFileManager instance 0x55b45d79ea80 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: DB pointer 0x55b45d7ae000 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/db_impl/db_impl.cc:902] ------- DUMPING STATS ------- 2024-05-25T05:09:01.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: rocksdb: [db/db_impl/db_impl.cc:903] 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** DB Stats ** 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 MB, 0.00 MB/s 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.7 0.00 0.00 1 0.000 0 0 2024-05-25T05:09:01.856 INFO:journalctl@ceph.mon.b.smithi136.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.7 0.00 0.00 1 0.000 0 0 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.7 0.00 0.00 1 0.000 0 0 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.7 0.00 0.00 1 0.000 0 0 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:09:01.857 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: ---------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: L0 1/0 1.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.7 0.00 0.00 1 0.000 0 0 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: Sum 1/0 1.63 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 5.7 0.00 0.00 1 0.000 0 0 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:09:01.858 INFO:journalctl@ceph.mon.b.smithi136.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 5.7 0.00 0.00 1 0.000 0 0 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative compaction: 0.00 GB write, 0.60 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval compaction: 0.00 GB write, 0.00 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b does not exist in monmap, will attempt to join an existing cluster 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: using public_addr v2:172.21.15.136:0/0 -> [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] 2024-05-25T05:09:01.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: starting mon.b rank -1 at public addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] at bind addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(???) e0 preinit fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).mds e1 new map 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).mds e1 print_map 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout: e1 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout: legacy client fscid: -1 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout: No filesystems configured 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e0 _set_cache_ratios kv ratio 0.25 inc ratio 0.375 full ratio 0.375 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e0 register_cache_with_pcm pcm target: 2147483648 pcm max: 1020054732 pcm min: 134217728 inc_osd_cache size: 1 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e1 e1: 0 total, 0 up, 0 in 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e2 e2: 0 total, 0 up, 0 in 2024-05-25T05:09:01.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e3 e3: 0 total, 0 up, 0 in 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e4 e4: 0 total, 0 up, 0 in 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e4 crush map has features 3314932999778484224, adjusting msgr requires 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).osd e4 crush map has features 288514050185494528, adjusting msgr requires 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2425022063' entity='client.admin' cmd=[{"prefix": "osd crush tunables", "profile": "default"}]: dispatch 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pgmap v5: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2425022063' entity='client.admin' cmd='[{"prefix": "osd crush tunables", "profile": "default"}]': finished 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: osdmap e4: 0 total, 0 up, 0 in 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pgmap v7: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.861 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='client.14184 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mon", "placement": "3;smithi088:172.21.15.88=a;smithi088:[v2:172.21.15.88:3301,v1:172.21.15.88:6790]=c;smithi136:172.21.15.136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: Saving service mon spec with placement smithi088:172.21.15.88=a;smithi088:[v2:172.21.15.88:3301,v1:172.21.15.88:6790]=c;smithi136:172.21.15.136=b;count:3 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: Deploying daemon mon.c on smithi088 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pgmap v8: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/1497741003' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pgmap v9: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.a calling monitor election 2024-05-25T05:09:01.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pgmap v10: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.c calling monitor election 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pgmap v11: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.a is new leader, mons a,c in quorum (ranks 0,1) 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: monmap e2: 2 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: fsmap 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: osdmap e4: 0 total, 0 up, 0 in 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mgrmap e13: y(active, since 35s) 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: overall HEALTH_OK 2024-05-25T05:09:01.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: Deploying daemon mon.b on smithi136 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/1752512343' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: pgmap v12: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing).paxosservice(auth 1..5) refresh upgraded, format 0 -> 3 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 ceph-mon[25618]: mon.b@-1(synchronizing) e2 handle_conf_change mon_allow_pool_delete,mon_cluster_log_to_file 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 bash[25599]: 5dae4d6e986be817525875820097edddff49a0297185e7cf1450700a3e8cee4f 2024-05-25T05:09:01.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:01 smithi136 systemd[1]: Started Ceph mon.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:09:06.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:06.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: mon.a calling monitor election 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: mon.c calling monitor election 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: mon.b calling monitor election 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:06.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: monmap e3: 3 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: fsmap 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: osdmap e4: 0 total, 0 up, 0 in 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: mgrmap e13: y(active, since 43s) 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: overall HEALTH_OK 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:06.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:07.004 INFO:teuthology.orchestra.run.smithi136.stdout: 2024-05-25T05:09:07.004 INFO:teuthology.orchestra.run.smithi136.stdout:{"epoch":3,"fsid":"9a885618-1a54-11ef-bc9b-c7b262605968","modified":"2024-05-25T05:09:01.561311Z","created":"2024-05-25T05:07:22.732162Z","min_mon_release":17,"min_mon_release_name":"quincy","election_strategy":1,"disallowed_leaders: ":"","stretch_mode":false,"tiebreaker_mon":"","features":{"persistent":["kraken","luminous","mimic","osdmap-prune","nautilus","octopus","pacific","elector-pinging","quincy"],"optional":[]},"mons":[{"rank":0,"name":"a","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3300","nonce":0},{"type":"v1","addr":"172.21.15.88:6789","nonce":0}]},"addr":"172.21.15.88:6789/0","public_addr":"172.21.15.88:6789/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":1,"name":"c","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:3301","nonce":0},{"type":"v1","addr":"172.21.15.88:6790","nonce":0}]},"addr":"172.21.15.88:6790/0","public_addr":"172.21.15.88:6790/0","priority":0,"weight":0,"crush_location":"{}"},{"rank":2,"name":"b","public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:3300","nonce":0},{"type":"v1","addr":"172.21.15.136:6789","nonce":0}]},"addr":"172.21.15.136:6789/0","public_addr":"172.21.15.136:6789/0","priority":0,"weight":0,"crush_location":"{}"}],"quorum":[0,1,2]} 2024-05-25T05:09:07.004 INFO:teuthology.orchestra.run.smithi136.stderr:dumped monmap epoch 3 2024-05-25T05:09:07.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: mon.a calling monitor election 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: mon.c calling monitor election 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: mon.b calling monitor election 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: monmap e3: 3 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: fsmap 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: osdmap e4: 0 total, 0 up, 0 in 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: mgrmap e13: y(active, since 43s) 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: overall HEALTH_OK 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: pgmap v13: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:07.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: mon.a calling monitor election 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: mon.c calling monitor election 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: pgmap v14: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: mon.b calling monitor election 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: pgmap v15: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:09:07.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: monmap e3: 3 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: fsmap 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: osdmap e4: 0 total, 0 up, 0 in 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: mgrmap e13: y(active, since 43s) 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:07.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:07.396 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:07.632 INFO:tasks.cephadm:Generating final ceph.conf file... 2024-05-25T05:09:07.633 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph config generate-minimal-conf 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/1903200216' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/1903200216' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.657 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:09:07.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/1903200216' entity='client.admin' cmd=[{"prefix": "mon dump", "format": "json"}]: dispatch 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:09:07.948 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:09:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:08.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:08 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:08] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:08.650 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:08.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:08.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: Reconfiguring mon.a (unknown last config time)... 2024-05-25T05:09:08.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: Reconfiguring daemon mon.a on smithi088 2024-05-25T05:09:08.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.651 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.652 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:08.652 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:08.652 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: Reconfiguring mon.a (unknown last config time)... 2024-05-25T05:09:08.652 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: Reconfiguring daemon mon.a on smithi088 2024-05-25T05:09:08.653 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.653 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.653 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.653 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:08 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: pgmap v16: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:08.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:08.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: Reconfiguring mon.a (unknown last config time)... 2024-05-25T05:09:08.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: Reconfiguring daemon mon.a on smithi088 2024-05-25T05:09:08.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:08.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:08 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:09.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:08 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:08] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:09.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:09 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:09.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:09 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:09.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:09 smithi136 ceph-mon[25618]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:10.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:09 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:09 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:09 smithi088 ceph-mon[29649]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:09 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:09 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:09 smithi088 ceph-mon[24736]: pgmap v17: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:10.777 INFO:teuthology.orchestra.run.smithi088.stdout:# minimal ceph.conf for 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:09:10.777 INFO:teuthology.orchestra.run.smithi088.stdout:[global] 2024-05-25T05:09:10.777 INFO:teuthology.orchestra.run.smithi088.stdout: fsid = 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:09:10.777 INFO:teuthology.orchestra.run.smithi088.stdout: mon_host = [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[24736]: Reconfiguring mon.c (monmap changed)... 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[24736]: Reconfiguring daemon mon.c on smithi088 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3894573713' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:11.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:11 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:11] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:11.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:11.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[29649]: Reconfiguring mon.c (monmap changed)... 2024-05-25T05:09:11.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:11.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:11.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:11.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[29649]: Reconfiguring daemon mon.c on smithi088 2024-05-25T05:09:11.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:11 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3894573713' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:11.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:11 smithi136 ceph-mon[25618]: Reconfiguring mon.c (monmap changed)... 2024-05-25T05:09:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:11 smithi136 ceph-mon[25618]: Reconfiguring daemon mon.c on smithi088 2024-05-25T05:09:11.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:11 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3894573713' entity='client.admin' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:11.736 INFO:tasks.cephadm:Distributing (final) config and client.admin keyring... 2024-05-25T05:09:11.736 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:09:11.736 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.conf 2024-05-25T05:09:11.807 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:09:11.807 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:09:11.874 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-25T05:09:11.874 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.conf 2024-05-25T05:09:11.907 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-25T05:09:11.908 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:09:11.975 INFO:tasks.cephadm:Adding mgr.y on smithi088 2024-05-25T05:09:11.975 INFO:tasks.cephadm:Adding mgr.x on smithi136 2024-05-25T05:09:11.975 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch apply mgr '2;smithi088=y;smithi136=x' 2024-05-25T05:09:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:12 smithi088 ceph-mon[29649]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:12 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:12 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:12 smithi088 ceph-mon[24736]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:12 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:12 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:12.498 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:12 smithi136 ceph-mon[25618]: pgmap v18: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:12.498 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:12 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:12.498 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:12 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:12.782 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:12 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:09:12] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:13.891 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled mgr update... 2024-05-25T05:09:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.610 DEBUG:teuthology.orchestra.run.smithi136:mgr.x> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service 2024-05-25T05:09:14.613 INFO:tasks.cephadm:Deploying OSDs... 2024-05-25T05:09:14.613 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:09:14.613 DEBUG:teuthology.orchestra.run.smithi088:> dd if=/scratch_devs of=/dev/stdout 2024-05-25T05:09:14.633 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-25T05:09:14.633 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_1 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-25 05:09:11.742439004 +0000 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-25 05:06:01.391315710 +0000 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-25 05:06:01.391315710 +0000 2024-05-25T05:09:14.692 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-25 05:06:01.391315710 +0000 2024-05-25T05:09:14.693 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-25T05:09:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-25T05:09:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-25T05:09:14.761 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000285257 s, 1.8 MB/s 2024-05-25T05:09:14.762 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-25T05:09:14.821 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_2 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-25 05:09:11.742439004 +0000 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-25 05:06:01.731308738 +0000 2024-05-25T05:09:14.878 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-25 05:06:01.731308738 +0000 2024-05-25T05:09:14.879 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-25 05:06:01.731308738 +0000 2024-05-25T05:09:14.879 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-25T05:09:14.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:14 smithi136 ceph-mon[25618]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:14 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:14 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:14 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:14 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:14 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[24736]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[29649]: pgmap v19: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:09:14.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:09:14.943 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:14.943 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:14 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:14.944 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-25T05:09:14.944 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-25T05:09:14.944 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000183994 s, 2.8 MB/s 2024-05-25T05:09:14.946 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-25T05:09:15.004 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_3 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-25 05:09:11.742439004 +0000 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-25 05:06:02.072301746 +0000 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-25 05:06:02.072301746 +0000 2024-05-25T05:09:15.061 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-25 05:06:02.072301746 +0000 2024-05-25T05:09:15.061 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-25T05:09:15.126 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-25T05:09:15.126 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-25T05:09:15.126 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000196777 s, 2.6 MB/s 2024-05-25T05:09:15.127 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-25T05:09:15.184 DEBUG:teuthology.orchestra.run.smithi088:> stat /dev/vg_nvme/lv_4 2024-05-25T05:09:15.240 INFO:teuthology.orchestra.run.smithi088.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-25T05:09:15.240 INFO:teuthology.orchestra.run.smithi088.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:15.240 INFO:teuthology.orchestra.run.smithi088.stdout:Device: 5h/5d Inode: 724 Links: 1 2024-05-25T05:09:15.240 INFO:teuthology.orchestra.run.smithi088.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:15.241 INFO:teuthology.orchestra.run.smithi088.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:15.241 INFO:teuthology.orchestra.run.smithi088.stdout:Access: 2024-05-25 05:09:11.742439004 +0000 2024-05-25T05:09:15.241 INFO:teuthology.orchestra.run.smithi088.stdout:Modify: 2024-05-25 05:06:02.415294713 +0000 2024-05-25T05:09:15.241 INFO:teuthology.orchestra.run.smithi088.stdout:Change: 2024-05-25 05:06:02.415294713 +0000 2024-05-25T05:09:15.241 INFO:teuthology.orchestra.run.smithi088.stdout: Birth: 2024-05-25 05:06:02.415294713 +0000 2024-05-25T05:09:15.241 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-25T05:09:15.304 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records in 2024-05-25T05:09:15.304 INFO:teuthology.orchestra.run.smithi088.stderr:1+0 records out 2024-05-25T05:09:15.304 INFO:teuthology.orchestra.run.smithi088.stderr:512 bytes copied, 0.000260564 s, 2.0 MB/s 2024-05-25T05:09:15.305 DEBUG:teuthology.orchestra.run.smithi088:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-25T05:09:15.362 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-25T05:09:15.362 DEBUG:teuthology.orchestra.run.smithi136:> dd if=/scratch_devs of=/dev/stdout 2024-05-25T05:09:15.378 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-05-25T05:09:15.378 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_1 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 665 Links: 1 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-25 05:09:10.516044098 +0000 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-25 05:06:00.268772910 +0000 2024-05-25T05:09:15.434 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-25 05:06:00.268772910 +0000 2024-05-25T05:09:15.435 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-25 05:06:00.268772910 +0000 2024-05-25T05:09:15.435 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-05-25T05:09:15.498 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-25T05:09:15.499 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-25T05:09:15.499 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000217085 s, 2.4 MB/s 2024-05-25T05:09:15.501 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-05-25T05:09:15.558 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_2 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 687 Links: 1 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-25 05:09:10.516044098 +0000 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-25 05:06:00.614765088 +0000 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-25 05:06:00.614765088 +0000 2024-05-25T05:09:15.615 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-25 05:06:00.614765088 +0000 2024-05-25T05:09:15.616 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-05-25T05:09:15.680 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-25T05:09:15.680 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-25T05:09:15.680 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000228685 s, 2.2 MB/s 2024-05-25T05:09:15.681 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-05-25T05:09:15.738 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_3 2024-05-25T05:09:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-05-25T05:09:15.794 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:15.795 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-05-25T05:09:15.795 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:15.795 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:15.795 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-25 05:09:10.516044098 +0000 2024-05-25T05:09:15.795 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-25 05:06:00.976756904 +0000 2024-05-25T05:09:15.795 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-25 05:06:00.976756904 +0000 2024-05-25T05:09:15.795 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-25 05:06:00.976756904 +0000 2024-05-25T05:09:15.795 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-05-25T05:09:15.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: Reconfiguring mon.b (monmap changed)... 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: Reconfiguring daemon mon.b on smithi136 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi088=y;smithi136=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: Saving service mgr spec with placement smithi088=y;smithi136=x;count:2 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:09:15.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:15.858 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-25T05:09:15.858 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-25T05:09:15.858 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000220041 s, 2.3 MB/s 2024-05-25T05:09:15.859 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-05-25T05:09:15.917 DEBUG:teuthology.orchestra.run.smithi136:> stat /dev/vg_nvme/lv_4 2024-05-25T05:09:15.972 INFO:teuthology.orchestra.run.smithi136.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-05-25T05:09:15.972 INFO:teuthology.orchestra.run.smithi136.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-05-25T05:09:15.972 INFO:teuthology.orchestra.run.smithi136.stdout:Device: 5h/5d Inode: 723 Links: 1 2024-05-25T05:09:15.972 INFO:teuthology.orchestra.run.smithi136.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-05-25T05:09:15.972 INFO:teuthology.orchestra.run.smithi136.stdout:Context: system_u:object_r:device_t:s0 2024-05-25T05:09:15.972 INFO:teuthology.orchestra.run.smithi136.stdout:Access: 2024-05-25 05:09:10.516044098 +0000 2024-05-25T05:09:15.972 INFO:teuthology.orchestra.run.smithi136.stdout:Modify: 2024-05-25 05:06:01.300749580 +0000 2024-05-25T05:09:15.973 INFO:teuthology.orchestra.run.smithi136.stdout:Change: 2024-05-25 05:06:01.300749580 +0000 2024-05-25T05:09:15.973 INFO:teuthology.orchestra.run.smithi136.stdout: Birth: 2024-05-25 05:06:01.300749580 +0000 2024-05-25T05:09:15.973 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-05-25T05:09:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records in 2024-05-25T05:09:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:1+0 records out 2024-05-25T05:09:16.037 INFO:teuthology.orchestra.run.smithi136.stderr:512 bytes copied, 0.000249465 s, 2.1 MB/s 2024-05-25T05:09:16.038 DEBUG:teuthology.orchestra.run.smithi136:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: Reconfiguring mon.b (monmap changed)... 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: Reconfiguring daemon mon.b on smithi136 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi088=y;smithi136=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: Saving service mgr spec with placement smithi088=y;smithi136=x;count:2 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-25T05:09:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: Reconfiguring mon.b (monmap changed)... 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: Reconfiguring daemon mon.b on smithi136 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='client.24110 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "mgr", "placement": "2;smithi088=y;smithi136=x", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: Saving service mgr spec with placement smithi088=y;smithi136=x;count:2 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:16.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:09:16.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]': finished 2024-05-25T05:09:16.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:09:16.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:16.095 INFO:tasks.cephadm:Deploying osd.0 on smithi088 with /dev/vg_nvme/lv_4... 2024-05-25T05:09:16.095 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-25T05:09:16.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:16 smithi088 ceph-mon[24736]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:16.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:16 smithi088 ceph-mon[24736]: Deploying daemon mgr.x on smithi136 2024-05-25T05:09:16.701 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:16 smithi088 ceph-mon[29649]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:16.701 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:16 smithi088 ceph-mon[29649]: Deploying daemon mgr.x on smithi136 2024-05-25T05:09:16.702 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:16 smithi136 ceph-mon[25618]: pgmap v20: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:16.702 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:16 smithi136 ceph-mon[25618]: Deploying daemon mgr.x on smithi136 2024-05-25T05:09:17.269 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 systemd[1]: Starting Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:09:17.519 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 podman[27135]: 2024-05-25 05:09:17.172309547 +0000 UTC m=+0.017235337 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:09:17.520 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 podman[27135]: 2024-05-25 05:09:17.272096518 +0000 UTC m=+0.117022312 container create 047da21182513c6efa453cd6a85cc267d6ad60ec1a0d9dbfbeb30f3a2ceeff92 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, name=centos-stream, vcs-type=git, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8) 2024-05-25T05:09:17.520 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 podman[27135]: 2024-05-25 05:09:17.516665501 +0000 UTC m=+0.361591295 container init 047da21182513c6efa453cd6a85cc267d6ad60ec1a0d9dbfbeb30f3a2ceeff92 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, RELEASE=HEAD, release=754, ceph=True, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-05-25T05:09:17.520 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 podman[27135]: 2024-05-25 05:09:17.519909573 +0000 UTC m=+0.364835373 container start 047da21182513c6efa453cd6a85cc267d6ad60ec1a0d9dbfbeb30f3a2ceeff92 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, com.redhat.component=centos-stream-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., vcs-type=git, ceph=True, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, distribution-scope=public, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, release=754, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-25T05:09:17.803 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 ceph-mgr[27154]: -- 172.21.15.136:0/3293373050 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55777afd8340 con 0x55777afb1000 2024-05-25T05:09:17.803 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 bash[27135]: 047da21182513c6efa453cd6a85cc267d6ad60ec1a0d9dbfbeb30f3a2ceeff92 2024-05-25T05:09:17.803 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 systemd[1]: Started Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:09:17.803 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:17.663+0000 7fd2474d0000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:09:17.803 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:17.802+0000 7fd2474d0000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:09:18.110 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:17 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:17.907+0000 7fd2474d0000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:09:18.162 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-25T05:09:18.162 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-25T05:09:18.162 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2024-05-25T05:09:18.162 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2024-05-25T05:09:18.162 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0110073 s, 953 MB/s 2024-05-25T05:09:18.162 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2024-05-25T05:09:18.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:18.228+0000 7fd2474d0000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:09:18.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:18.311+0000 7fd2474d0000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:09:18.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: pgmap v21: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:18.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:18.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:18.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:18.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:18.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:09:18.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:09:18.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:18.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:19.216 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_4 2024-05-25T05:09:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:19 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:19 smithi136 ceph-mon[25618]: Reconfiguring mgr.y (unknown last config time)... 2024-05-25T05:09:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:19 smithi136 ceph-mon[25618]: Reconfiguring daemon mgr.y on smithi088 2024-05-25T05:09:19.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:19 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:19.541+0000 7fd2474d0000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:09:19.848 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:19 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:19.848 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:19 smithi088 ceph-mon[24736]: Reconfiguring mgr.y (unknown last config time)... 2024-05-25T05:09:19.849 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:19 smithi088 ceph-mon[24736]: Reconfiguring daemon mgr.y on smithi088 2024-05-25T05:09:19.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:19 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:19.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:19 smithi088 ceph-mon[29649]: Reconfiguring mgr.y (unknown last config time)... 2024-05-25T05:09:19.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:19 smithi088 ceph-mon[29649]: Reconfiguring daemon mgr.y on smithi088 2024-05-25T05:09:19.990 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:19 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:19.733+0000 7fd2474d0000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:09:19.990 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:19 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:19.821+0000 7fd2474d0000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:09:20.250 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:20.157+0000 7fd2474d0000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:09:20.598 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:20.250+0000 7fd2474d0000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:09:20.598 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:20.346+0000 7fd2474d0000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:20.606+0000 7fd2474d0000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:09:20.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: pgmap v22: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:21] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:21.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:21.056+0000 7fd2474d0000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:09:21.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:21.873 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:09:21.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:21.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:21.539+0000 7fd2474d0000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:09:21.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:21.633+0000 7fd2474d0000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:09:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:22.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:21.925+0000 7fd2474d0000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:09:22.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:22.014+0000 7fd2474d0000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:09:22.754 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:22 smithi136 ceph-mon[25618]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:22.754 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:22 smithi136 ceph-mon[25618]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:22.755 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:22.414+0000 7fd2474d0000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:09:22.755 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:22.546+0000 7fd2474d0000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:09:22.755 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:22.640+0000 7fd2474d0000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:09:22.755 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:22.754+0000 7fd2474d0000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:09:22.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:22 smithi088 ceph-mon[24736]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:22.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:22 smithi088 ceph-mon[24736]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:22 smithi088 ceph-mon[29649]: pgmap v23: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:22 smithi088 ceph-mon[29649]: from='client.24118 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:23.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:22.843+0000 7fd2474d0000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:09:23.749 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:23.385+0000 7fd2474d0000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:09:23.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:09:23.750 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:09:23.750 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:23 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2092133264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]: dispatch 2024-05-25T05:09:23.750 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:23 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]: dispatch 2024-05-25T05:09:23.750 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:23 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]': finished 2024-05-25T05:09:23.750 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:23 smithi136 ceph-mon[25618]: osdmap e5: 1 total, 0 up, 1 in 2024-05-25T05:09:23.750 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2092133264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]: dispatch 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]: dispatch 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]': finished 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[24736]: osdmap e5: 1 total, 0 up, 1 in 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:24.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:09:24.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:09:24.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2092133264' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]: dispatch 2024-05-25T05:09:24.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]: dispatch 2024-05-25T05:09:24.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "2870ce62-38d4-45ad-8d11-fad3a2bef386"}]': finished 2024-05-25T05:09:24.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[29649]: osdmap e5: 1 total, 0 up, 1 in 2024-05-25T05:09:24.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:24.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:09:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:09:23.748+0000 7fd2474d0000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:09:24.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:24 smithi136 ceph-mon[25618]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:24 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:09:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:24 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:09:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:24 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:09:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:24 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:09:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:24 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:09:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:24 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2021199318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[24736]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2021199318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[29649]: pgmap v24: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:09:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:09:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:09:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:09:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1044590610' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:09:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:24 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2021199318' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:09:25.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:25 smithi136 ceph-mon[25618]: mgrmap e14: y(active, since 61s), standbys: x 2024-05-25T05:09:25.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:25 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:09:26.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:25 smithi088 ceph-mon[24736]: mgrmap e14: y(active, since 61s), standbys: x 2024-05-25T05:09:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:09:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:25 smithi088 ceph-mon[29649]: mgrmap e14: y(active, since 61s), standbys: x 2024-05-25T05:09:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:25 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:09:26.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:26 smithi136 ceph-mon[25618]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:27.001 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:26 smithi088 ceph-mon[24736]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:27.001 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:26 smithi088 ceph-mon[29649]: pgmap v26: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:28.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:28 smithi136 ceph-mon[25618]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:28.930 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:28 smithi088 ceph-mon[24736]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:28.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:28 smithi088 ceph-mon[29649]: pgmap v27: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:30 smithi136 ceph-mon[25618]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:30 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:09:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:30 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:30.912 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:30 smithi088 ceph-mon[24736]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:30.912 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:30 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:09:30.912 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:30 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:30.913 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:30 smithi088 ceph-mon[29649]: pgmap v28: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:30.913 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:30 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:09:30.913 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:30 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:32.019 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:31 smithi088 ceph-mon[24736]: Deploying daemon osd.0 on smithi088 2024-05-25T05:09:32.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:31 smithi088 ceph-mon[29649]: Deploying daemon osd.0 on smithi088 2024-05-25T05:09:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:31 smithi136 ceph-mon[25618]: Deploying daemon osd.0 on smithi088 2024-05-25T05:09:32.765 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:32 smithi088 ceph-mon[24736]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:32.765 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:32 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:09:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:32.766 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:32 smithi088 ceph-mon[29649]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:33.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:32 smithi136 ceph-mon[25618]: pgmap v29: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:33.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:33.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi088 2024-05-25T05:09:33.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:33.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[24736]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:33.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:33.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi088 2024-05-25T05:09:33.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:33.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:33 smithi088 ceph-mon[29649]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:33.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:33.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:33 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi088 2024-05-25T05:09:33.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:33.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:33 smithi136 ceph-mon[25618]: pgmap v30: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:36.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:35 smithi088 ceph-mon[24736]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:36.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:35 smithi088 ceph-mon[29649]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:35 smithi136 ceph-mon[25618]: pgmap v31: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[24736]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[29649]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:38.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:37 smithi136 ceph-mon[25618]: pgmap v32: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:38.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:38.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:38.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:38.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:39.406 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:39.437 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 0 on host 'smithi088' 2024-05-25T05:09:40.024 DEBUG:teuthology.orchestra.run.smithi088:osd.0> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.0.service 2024-05-25T05:09:40.026 INFO:tasks.cephadm:Deploying osd.1 on smithi088 with /dev/vg_nvme/lv_3... 2024-05-25T05:09:40.027 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-25T05:09:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:09:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi088 to 15040M 2024-05-25T05:09:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:09:40.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:40 smithi136 ceph-mon[25618]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:09:40.697 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi088 to 15040M 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[24736]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: pgmap v33: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:09:40.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:09:40.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi088 to 15040M 2024-05-25T05:09:40.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:40.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:09:40.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:40 smithi088 ceph-mon[29649]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:09:41.600 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[24736]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:09:41.600 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[24736]: osdmap e6: 1 total, 0 up, 1 in 2024-05-25T05:09:41.600 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:41.600 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[24736]: from='osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:09:41.600 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[24736]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:09:41.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[29649]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:09:41.601 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[29649]: osdmap e6: 1 total, 0 up, 1 in 2024-05-25T05:09:41.601 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:41.601 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[29649]: from='osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:09:41.601 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:41 smithi088 ceph-mon[29649]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:09:41.601 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:09:41 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[32920]: 2024-05-25T05:09:41.496+0000 7fcf23fc3700 -1 osd.0 0 waiting for initial osdmap 2024-05-25T05:09:41.601 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:09:41 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[32920]: 2024-05-25T05:09:41.498+0000 7fcf1e95a700 -1 osd.0 7 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:09:41.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:41 smithi136 ceph-mon[25618]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:09:41.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:41 smithi136 ceph-mon[25618]: osdmap e6: 1 total, 0 up, 1 in 2024-05-25T05:09:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:41 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:41 smithi136 ceph-mon[25618]: from='osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:09:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:41 smithi136 ceph-mon[25618]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:09:42.073 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-25T05:09:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-25T05:09:42.074 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2024-05-25T05:09:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2024-05-25T05:09:42.074 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.0120982 s, 867 MB/s 2024-05-25T05:09:42.074 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2024-05-25T05:09:42.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[24736]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:42.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[24736]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:09:42.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[24736]: osdmap e7: 1 total, 0 up, 1 in 2024-05-25T05:09:42.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:42.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:42.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[29649]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:42.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[29649]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:09:42.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[29649]: osdmap e7: 1 total, 0 up, 1 in 2024-05-25T05:09:42.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:42.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:42 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:42.773 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_3 2024-05-25T05:09:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:42 smithi136 ceph-mon[25618]: pgmap v35: 0 pgs: ; 0 B data, 0 B used, 0 B / 0 B avail 2024-05-25T05:09:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:42 smithi136 ceph-mon[25618]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:09:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:42 smithi136 ceph-mon[25618]: osdmap e7: 1 total, 0 up, 1 in 2024-05-25T05:09:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:42 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:42 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:43.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[24736]: osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643] boot 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[24736]: osdmap e8: 1 total, 1 up, 1 in 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[29649]: osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643] boot 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[29649]: osdmap e8: 1 total, 1 up, 1 in 2024-05-25T05:09:43.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:43 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:43 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:09:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:43 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:09:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:43 smithi136 ceph-mon[25618]: osd.0 [v2:172.21.15.88:6802/1207909643,v1:172.21.15.88:6803/1207909643] boot 2024-05-25T05:09:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:43 smithi136 ceph-mon[25618]: osdmap e8: 1 total, 1 up, 1 in 2024-05-25T05:09:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:43 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:09:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:44 smithi136 ceph-mon[25618]: pgmap v38: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:44.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:44 smithi136 ceph-mon[25618]: osdmap e9: 1 total, 1 up, 1 in 2024-05-25T05:09:44.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:44 smithi088 ceph-mon[24736]: pgmap v38: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:44.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:44 smithi088 ceph-mon[24736]: osdmap e9: 1 total, 1 up, 1 in 2024-05-25T05:09:44.684 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:44 smithi088 ceph-mon[29649]: pgmap v38: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:44.684 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:44 smithi088 ceph-mon[29649]: osdmap e9: 1 total, 1 up, 1 in 2024-05-25T05:09:45.648 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:45 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:09:45.648 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:45 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:09:45.648 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:45 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:45.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:09:45.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:09:45.649 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:45 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:45.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:45 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:09:45.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:45 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:09:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:45 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:46.585 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:46 smithi088 ceph-mon[24736]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:46.585 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:46 smithi088 ceph-mon[24736]: pgmap v40: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:46.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:46 smithi088 ceph-mon[29649]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:46.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:46 smithi088 ceph-mon[29649]: pgmap v40: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:46.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:46 smithi136 ceph-mon[25618]: from='client.24145 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:09:46.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:46 smithi136 ceph-mon[25618]: pgmap v40: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:47.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:09:47] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3475561543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]: dispatch 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]: dispatch 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]': finished 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: osdmap e10: 2 total, 1 up, 2 in 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1773783490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:09:48.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3475561543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]: dispatch 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]: dispatch 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]': finished 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: osdmap e10: 2 total, 1 up, 2 in 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:09:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:48 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1773783490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:09:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: pgmap v41: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:09:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3475561543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]: dispatch 2024-05-25T05:09:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]: dispatch 2024-05-25T05:09:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "abf35f19-27d1-499d-a7c5-2960d202841a"}]': finished 2024-05-25T05:09:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: osdmap e10: 2 total, 1 up, 2 in 2024-05-25T05:09:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:09:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:48 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1773783490' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:09:50.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:50 smithi088 ceph-mon[24736]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:50.726 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:50 smithi088 ceph-mon[29649]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:50 smithi136 ceph-mon[25618]: pgmap v43: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:52.797 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:52 smithi088 ceph-mon[24736]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:52.798 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:52 smithi088 ceph-mon[29649]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:52.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:52 smithi136 ceph-mon[25618]: pgmap v44: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:54.746 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:54 smithi088 ceph-mon[24736]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:54.746 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-25T05:09:54.746 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:54.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:54 smithi088 ceph-mon[29649]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:54.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-25T05:09:54.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:54.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:54 smithi136 ceph-mon[25618]: pgmap v45: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:54.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-25T05:09:54.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:09:55.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:55 smithi088 ceph-mon[24736]: Deploying daemon osd.1 on smithi088 2024-05-25T05:09:55.780 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:55 smithi088 ceph-mon[29649]: Deploying daemon osd.1 on smithi088 2024-05-25T05:09:55.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:55 smithi136 ceph-mon[25618]: Deploying daemon osd.1 on smithi088 2024-05-25T05:09:56.754 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:56 smithi088 ceph-mon[29649]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:56.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:56 smithi088 ceph-mon[24736]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:56.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:56 smithi136 ceph-mon[25618]: pgmap v46: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:58.591 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:09:58 smithi088 ceph-mon[24736]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:58.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:09:58 smithi088 ceph-mon[29649]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:58.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:09:58 smithi136 ceph-mon[25618]: pgmap v47: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:09:59.740 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:09:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:09:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:00.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:00.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:00.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:00.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:00.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:00 smithi136 ceph-mon[25618]: overall HEALTH_OK 2024-05-25T05:10:00.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:00.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:00.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:00.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:00.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[24736]: overall HEALTH_OK 2024-05-25T05:10:00.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: pgmap v48: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:00.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:00.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:00.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:00.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:00.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:00 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:10:01.988 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 1 on host 'smithi088' 2024-05-25T05:10:02.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:02.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:02.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:02.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:02.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:02.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: pgmap v49: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:02.703 DEBUG:teuthology.orchestra.run.smithi088:osd.1> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.1.service 2024-05-25T05:10:02.705 INFO:tasks.cephadm:Deploying osd.2 on smithi088 with /dev/vg_nvme/lv_2... 2024-05-25T05:10:02.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-25T05:10:03.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:03 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi088 to 7520M 2024-05-25T05:10:03.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:03 smithi088 ceph-mon[24736]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-25T05:10:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:03 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi088 to 7520M 2024-05-25T05:10:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:03 smithi088 ceph-mon[29649]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-25T05:10:03.535 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:03 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi088 to 7520M 2024-05-25T05:10:03.536 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:03 smithi136 ceph-mon[25618]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]: dispatch 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[24736]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[24736]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[24736]: osdmap e11: 2 total, 1 up, 2 in 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[24736]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[29649]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[29649]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-25T05:10:04.240 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[29649]: osdmap e11: 2 total, 1 up, 2 in 2024-05-25T05:10:04.241 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:04.241 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:04 smithi088 ceph-mon[29649]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:04.241 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1[35795]: 2024-05-25T05:10:04.166+0000 7ff6346b7700 -1 osd.1 0 waiting for initial osdmap 2024-05-25T05:10:04.241 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1[35795]: 2024-05-25T05:10:04.170+0000 7ff631052700 -1 osd.1 12 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:10:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:04 smithi136 ceph-mon[25618]: pgmap v50: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:04 smithi136 ceph-mon[25618]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["1"]}]': finished 2024-05-25T05:10:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:04 smithi136 ceph-mon[25618]: osdmap e11: 2 total, 1 up, 2 in 2024-05-25T05:10:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:04 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:04 smithi136 ceph-mon[25618]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd=[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:04.710 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-25T05:10:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-25T05:10:04.711 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2024-05-25T05:10:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2024-05-25T05:10:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0129401 s, 810 MB/s 2024-05-25T05:10:04.711 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2024-05-25T05:10:05.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[24736]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:05.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[24736]: osdmap e12: 2 total, 1 up, 2 in 2024-05-25T05:10:05.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:05.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:05.326 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[29649]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:05.326 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[29649]: osdmap e12: 2 total, 1 up, 2 in 2024-05-25T05:10:05.326 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:05.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:05 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:05.351 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_2 2024-05-25T05:10:05.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:05 smithi136 ceph-mon[25618]: from='osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184]' entity='osd.1' cmd='[{"prefix": "osd crush create-or-move", "id": 1, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:05.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:05 smithi136 ceph-mon[25618]: osdmap e12: 2 total, 1 up, 2 in 2024-05-25T05:10:05.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:05 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:05.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:05 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:06.249 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[24736]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[24736]: osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184] boot 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[24736]: osdmap e13: 2 total, 2 up, 2 in 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[29649]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:06.250 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:06.251 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[29649]: osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184] boot 2024-05-25T05:10:06.251 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[29649]: osdmap e13: 2 total, 2 up, 2 in 2024-05-25T05:10:06.251 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:06.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:06 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:10:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:06 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:10:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:06 smithi136 ceph-mon[25618]: pgmap v53: 0 pgs: ; 0 B data, 4.8 MiB used, 89 GiB / 89 GiB avail 2024-05-25T05:10:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:06 smithi136 ceph-mon[25618]: osd.1 [v2:172.21.15.88:6810/1328023184,v1:172.21.15.88:6811/1328023184] boot 2024-05-25T05:10:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:06 smithi136 ceph-mon[25618]: osdmap e13: 2 total, 2 up, 2 in 2024-05-25T05:10:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:10:07.182 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:10:07] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:07.545 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[24736]: osdmap e14: 2 total, 2 up, 2 in 2024-05-25T05:10:07.545 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.545 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.545 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:07.545 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:07.545 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:07.545 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.546 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[29649]: osdmap e14: 2 total, 2 up, 2 in 2024-05-25T05:10:07.546 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.546 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.546 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:07.546 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:07.546 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:07.546 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:07 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:07 smithi136 ceph-mon[25618]: osdmap e14: 2 total, 2 up, 2 in 2024-05-25T05:10:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:07 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: pgmap v56: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi088 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: pgmap v57: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: pgmap v56: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:08.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi088 2024-05-25T05:10:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: pgmap v57: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:10:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:08 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:08.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: pgmap v56: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi088 2024-05-25T05:10:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: pgmap v57: 0 pgs: ; 0 B data, 9.7 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:10:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: from='client.24172 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:08.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:08 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:10.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:10 smithi088 ceph-mon[24736]: pgmap v58: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:10.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:10 smithi088 ceph-mon[29649]: pgmap v58: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:10.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:10 smithi136 ceph-mon[25618]: pgmap v58: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:11.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:10 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:10:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3496460728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]: dispatch 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]: dispatch 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]': finished 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: osdmap e15: 3 total, 2 up, 3 in 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2905957542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3496460728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]: dispatch 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]: dispatch 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]': finished 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: osdmap e15: 3 total, 2 up, 3 in 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:11 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2905957542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:11.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3496460728' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]: dispatch 2024-05-25T05:10:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]: dispatch 2024-05-25T05:10:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "dbc42aa3-f39d-4122-b4df-4510e612e1b5"}]': finished 2024-05-25T05:10:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: osdmap e15: 3 total, 2 up, 3 in 2024-05-25T05:10:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:11 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2905957542' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:12 smithi088 ceph-mon[24736]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:12 smithi088 ceph-mon[24736]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:10:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:12 smithi088 ceph-mon[24736]: Cluster is now healthy 2024-05-25T05:10:12.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:12 smithi088 ceph-mon[29649]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:12.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:12 smithi088 ceph-mon[29649]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:10:12.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:12 smithi088 ceph-mon[29649]: Cluster is now healthy 2024-05-25T05:10:12.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:12 smithi136 ceph-mon[25618]: pgmap v60: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:12.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:12 smithi136 ceph-mon[25618]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:10:12.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:12 smithi136 ceph-mon[25618]: Cluster is now healthy 2024-05-25T05:10:14.712 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:14 smithi088 ceph-mon[29649]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:14.712 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:14 smithi088 ceph-mon[24736]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:14.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:14 smithi136 ceph-mon[25618]: pgmap v61: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:16.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:16 smithi088 ceph-mon[29649]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:16.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:16 smithi088 ceph-mon[24736]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:16.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:16 smithi136 ceph-mon[25618]: pgmap v62: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:18.618 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:18 smithi088 ceph-mon[29649]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:18.618 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-25T05:10:18.618 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:18 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:18.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:18 smithi088 ceph-mon[24736]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:18.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-25T05:10:18.619 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:18 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:18.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:18 smithi136 ceph-mon[25618]: pgmap v63: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:18.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-25T05:10:18.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:18 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:19.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:19 smithi088 ceph-mon[24736]: Deploying daemon osd.2 on smithi088 2024-05-25T05:10:19.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:19 smithi088 ceph-mon[29649]: Deploying daemon osd.2 on smithi088 2024-05-25T05:10:19.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:19 smithi136 ceph-mon[25618]: Deploying daemon osd.2 on smithi088 2024-05-25T05:10:19.929 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:10:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:20.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:20 smithi136 ceph-mon[25618]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:20.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:20.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:20.898 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:20 smithi088 ceph-mon[29649]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:20.898 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:20.898 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:20.898 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:20 smithi088 ceph-mon[24736]: pgmap v64: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:20.898 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:20.899 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:22.829 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:22 smithi088 ceph-mon[24736]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:22.829 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:22 smithi088 ceph-mon[29649]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:22 smithi136 ceph-mon[25618]: pgmap v65: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:23.682 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:10:23.682 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:10:23.682 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:23.682 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:23.683 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:10:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:10:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:24.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:24 smithi088 ceph-mon[24736]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:24.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:24 smithi088 ceph-mon[29649]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:24.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:24 smithi136 ceph-mon[25618]: pgmap v66: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:25.782 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 2 on host 'smithi088' 2024-05-25T05:10:26.459 DEBUG:teuthology.orchestra.run.smithi088:osd.2> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.2.service 2024-05-25T05:10:26.461 INFO:tasks.cephadm:Deploying osd.3 on smithi088 with /dev/vg_nvme/lv_1... 2024-05-25T05:10:26.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-25T05:10:26.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:26.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[24736]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-25T05:10:26.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-25T05:10:26.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:26 smithi088 ceph-mon[29649]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-25T05:10:26.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: pgmap v67: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164]' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-25T05:10:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:26 smithi136 ceph-mon[25618]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]: dispatch 2024-05-25T05:10:27.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi088 to 5013M 2024-05-25T05:10:27.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[29649]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-25T05:10:27.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[29649]: osdmap e16: 3 total, 2 up, 3 in 2024-05-25T05:10:27.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:27.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[29649]: from='osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:27.849 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[29649]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:27.850 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi088 to 5013M 2024-05-25T05:10:27.850 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[24736]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-25T05:10:27.850 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[24736]: osdmap e16: 3 total, 2 up, 3 in 2024-05-25T05:10:27.850 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:27.850 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[24736]: from='osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:27.850 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:27 smithi088 ceph-mon[24736]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:27.850 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:27 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2[38713]: 2024-05-25T05:10:27.811+0000 7fa5a9762700 -1 osd.2 0 waiting for initial osdmap 2024-05-25T05:10:27.851 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:27 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2[38713]: 2024-05-25T05:10:27.814+0000 7fa5a48fa700 -1 osd.2 17 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:10:27.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:27 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi088 to 5013M 2024-05-25T05:10:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:27 smithi136 ceph-mon[25618]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["2"]}]': finished 2024-05-25T05:10:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:27 smithi136 ceph-mon[25618]: osdmap e16: 3 total, 2 up, 3 in 2024-05-25T05:10:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:27 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:27 smithi136 ceph-mon[25618]: from='osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164]' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:27 smithi136 ceph-mon[25618]: from='osd.2 ' entity='osd.2' cmd=[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:28.401 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-25T05:10:28.402 INFO:teuthology.orchestra.run.smithi088.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-25T05:10:28.402 INFO:teuthology.orchestra.run.smithi088.stderr: stderr: 10+0 records in 2024-05-25T05:10:28.402 INFO:teuthology.orchestra.run.smithi088.stderr:10+0 records out 2024-05-25T05:10:28.402 INFO:teuthology.orchestra.run.smithi088.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.0120769 s, 868 MB/s 2024-05-25T05:10:28.402 INFO:teuthology.orchestra.run.smithi088.stderr:--> Zapping successful for: 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[24736]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[24736]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[24736]: osdmap e17: 3 total, 2 up, 3 in 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[29649]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[29649]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[29649]: osdmap e17: 3 total, 2 up, 3 in 2024-05-25T05:10:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:28 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:28.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:28 smithi136 ceph-mon[25618]: pgmap v69: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:28.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:28 smithi136 ceph-mon[25618]: from='osd.2 ' entity='osd.2' cmd='[{"prefix": "osd crush create-or-move", "id": 2, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:28.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:28 smithi136 ceph-mon[25618]: osdmap e17: 3 total, 2 up, 3 in 2024-05-25T05:10:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:28 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:28 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:29.004 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi088:vg_nvme/lv_1 2024-05-25T05:10:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:29 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:10:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:29 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:10:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:29 smithi136 ceph-mon[25618]: osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164] boot 2024-05-25T05:10:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:29 smithi136 ceph-mon[25618]: osdmap e18: 3 total, 3 up, 3 in 2024-05-25T05:10:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:29 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:29 smithi136 ceph-mon[25618]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:30.200 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:10:30.200 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:10:30.200 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[24736]: osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164] boot 2024-05-25T05:10:30.200 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[24736]: osdmap e18: 3 total, 3 up, 3 in 2024-05-25T05:10:30.200 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:30.201 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[24736]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:30.201 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:10:30.201 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:10:30.201 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[29649]: osd.2 [v2:172.21.15.88:6818/4166017164,v1:172.21.15.88:6819/4166017164] boot 2024-05-25T05:10:30.201 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[29649]: osdmap e18: 3 total, 3 up, 3 in 2024-05-25T05:10:30.201 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:10:30.201 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:29 smithi088 ceph-mon[29649]: pgmap v72: 0 pgs: ; 0 B data, 9.8 MiB used, 179 GiB / 179 GiB avail 2024-05-25T05:10:31.219 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:31 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:10:31] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:31.220 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:31 smithi088 ceph-mon[29649]: osdmap e19: 3 total, 3 up, 3 in 2024-05-25T05:10:31.220 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:31 smithi088 ceph-mon[24736]: osdmap e19: 3 total, 3 up, 3 in 2024-05-25T05:10:31.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:31 smithi136 ceph-mon[25618]: osdmap e19: 3 total, 3 up, 3 in 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: pgmap v74: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi088 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:32.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: pgmap v75: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: osdmap e20: 3 total, 3 up, 3 in 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:32.194 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: pgmap v74: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi088 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: pgmap v75: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: osdmap e20: 3 total, 3 up, 3 in 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:32.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:32.196 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:32.196 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]: dispatch 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: pgmap v74: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi088 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: pgmap v75: 0 pgs: ; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:10:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "osd pool create", "format": "json", "pool": ".mgr", "pg_num": 1, "pg_num_min": 1, "pg_num_max": 32}]': finished 2024-05-25T05:10:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: osdmap e20: 3 total, 3 up, 3 in 2024-05-25T05:10:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]: dispatch 2024-05-25T05:10:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='client.24199 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi088:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:32.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-25T05:10:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:33 smithi136 ceph-mon[25618]: osdmap e21: 3 total, 3 up, 3 in 2024-05-25T05:10:33.416 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-25T05:10:33.416 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:33 smithi088 ceph-mon[24736]: osdmap e21: 3 total, 3 up, 3 in 2024-05-25T05:10:33.417 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "osd pool application enable", "format": "json", "pool": ".mgr", "app": "mgr", "yes_i_really_mean_it": true}]': finished 2024-05-25T05:10:33.417 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:33 smithi088 ceph-mon[29649]: osdmap e21: 3 total, 3 up, 3 in 2024-05-25T05:10:33.417 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40010]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-25T05:10:33.417 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40010]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:33.417 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40010]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:33.746 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40015]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-25T05:10:33.746 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40015]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:33.746 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40015]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:34.008 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40046]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-25T05:10:34.008 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40046]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:34.008 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:33 smithi088 sudo[40046]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:34.264 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:34 smithi088 ceph-mon[24736]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:34.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:34 smithi088 ceph-mon[24736]: osdmap e22: 3 total, 3 up, 3 in 2024-05-25T05:10:34.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:34 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:34.265 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40068]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-25T05:10:34.265 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40068]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:34.265 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40068]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:34.265 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:34 smithi088 ceph-mon[29649]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:34.265 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:34 smithi088 ceph-mon[29649]: osdmap e22: 3 total, 3 up, 3 in 2024-05-25T05:10:34.266 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:34 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:34 smithi136 ceph-mon[25618]: pgmap v78: 1 pgs: 1 creating+peering; 0 B data, 15 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:34 smithi136 ceph-mon[25618]: osdmap e22: 3 total, 3 up, 3 in 2024-05-25T05:10:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:34 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:34.522 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40143]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-25T05:10:34.522 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40143]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:34.523 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40143]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:34.784 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40150]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-25T05:10:34.784 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40150]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:34.784 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40150]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:34.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40153]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-25T05:10:34.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40153]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:35.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:34 smithi088 sudo[40153]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:35.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40204]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-25T05:10:35.292 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40204]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:35.292 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40204]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:35.552 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40209]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-25T05:10:35.552 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40209]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:35.552 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40209]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:35.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:10:35] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40226]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-25T05:10:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40226]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:35 smithi088 sudo[40226]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:36.049 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:35 smithi136 sudo[28119]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/smartctl -x --json=o /dev/nvme0n1 2024-05-25T05:10:36.050 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:35 smithi136 sudo[28119]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:36.050 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:35 smithi136 sudo[28119]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:36.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:36.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:36.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:36.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 sudo[28122]: ceph : TTY=unknown ; PWD=/ ; USER=root ; COMMAND=/sbin/nvme intel smart-log-add --json /dev/nvme0n1 2024-05-25T05:10:36.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 sudo[28122]: pam_unix(sudo:session): session opened for user root by (uid=0) 2024-05-25T05:10:36.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 sudo[28122]: pam_unix(sudo:session): session closed for user root 2024-05-25T05:10:36.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:36.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:36.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:36.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:36.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:36.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: Cluster is now healthy 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2597766685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]: dispatch 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: mgrmap e15: y(active, since 2m), standbys: x 2024-05-25T05:10:37.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]: dispatch 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]': finished 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: osdmap e23: 4 total, 3 up, 4 in 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/445468017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: Cluster is now healthy 2024-05-25T05:10:37.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2597766685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]: dispatch 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: mgrmap e15: y(active, since 2m), standbys: x 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]: dispatch 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]': finished 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: osdmap e23: 4 total, 3 up, 4 in 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:37 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/445468017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:37.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: pgmap v80: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: pgmap v81: 1 pgs: 1 creating+peering; 0 B data, 16 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: Cluster is now healthy 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='admin socket' entity='admin socket' cmd='smart' args=[json]: dispatch 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2597766685' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]: dispatch 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='admin socket' entity='admin socket' cmd=smart args=[json]: finished 2024-05-25T05:10:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: mgrmap e15: y(active, since 2m), standbys: x 2024-05-25T05:10:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]: dispatch 2024-05-25T05:10:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673"}]': finished 2024-05-25T05:10:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: osdmap e23: 4 total, 3 up, 4 in 2024-05-25T05:10:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:37 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/445468017' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:38 smithi136 ceph-mon[25618]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:38.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:38 smithi088 ceph-mon[29649]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:38 smithi088 ceph-mon[24736]: pgmap v83: 1 pgs: 1 active+clean; 577 KiB data, 17 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:39.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:10:39] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:40.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:40 smithi136 ceph-mon[25618]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:40.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:40.749 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:40.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:40 smithi088 ceph-mon[24736]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:40 smithi088 ceph-mon[29649]: pgmap v84: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:42.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:42 smithi088 ceph-mon[24736]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:42.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:42 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-25T05:10:42.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:42 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:42.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:42 smithi088 ceph-mon[29649]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:42.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:42 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-25T05:10:42.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:42 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:42 smithi136 ceph-mon[25618]: pgmap v85: 1 pgs: 1 active+clean; 577 KiB data, 18 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:42 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-25T05:10:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:42 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:43.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:43 smithi088 ceph-mon[24736]: Deploying daemon osd.3 on smithi088 2024-05-25T05:10:43.665 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:43 smithi088 ceph-mon[29649]: Deploying daemon osd.3 on smithi088 2024-05-25T05:10:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:43 smithi136 ceph-mon[25618]: Deploying daemon osd.3 on smithi088 2024-05-25T05:10:44.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:44 smithi088 ceph-mon[29649]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:44.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:44 smithi088 ceph-mon[24736]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:44.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:44 smithi136 ceph-mon[25618]: pgmap v86: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:46.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:46 smithi088 ceph-mon[24736]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:46.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:46 smithi088 ceph-mon[29649]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:46.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:46 smithi136 ceph-mon[25618]: pgmap v87: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:48 smithi136 ceph-mon[25618]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:48 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:48.431 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[24736]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:48.431 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:48.431 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:48.431 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:48.431 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:48.431 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:48.431 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[29649]: pgmap v88: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:48.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:48.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:48.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:48.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:48.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:48 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:49.894 INFO:teuthology.orchestra.run.smithi088.stdout:Created osd(s) 3 on host 'smithi088' 2024-05-25T05:10:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[24736]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:50 smithi088 ceph-mon[29649]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-25T05:10:50.861 DEBUG:teuthology.orchestra.run.smithi088:osd.3> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.3.service 2024-05-25T05:10:50.863 INFO:tasks.cephadm:Deploying osd.4 on smithi136 with /dev/vg_nvme/lv_4... 2024-05-25T05:10:50.863 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_4 2024-05-25T05:10:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: pgmap v89: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:10:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:10:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.0", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.1", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.2", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.3", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:10:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:50 smithi136 ceph-mon[25618]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]: dispatch 2024-05-25T05:10:51.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi088 to 3760M 2024-05-25T05:10:51.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[24736]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[24736]: osdmap e24: 4 total, 3 up, 4 in 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[24736]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi088 to 3760M 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[29649]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[29649]: osdmap e24: 4 total, 3 up, 4 in 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:51.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:51 smithi088 ceph-mon[29649]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:51.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:51 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi088 to 3760M 2024-05-25T05:10:51.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:51 smithi136 ceph-mon[25618]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["3"]}]': finished 2024-05-25T05:10:51.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:51 smithi136 ceph-mon[25618]: osdmap e24: 4 total, 3 up, 4 in 2024-05-25T05:10:51.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:51 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:51.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:51 smithi136 ceph-mon[25618]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd=[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:10:51.979 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:10:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3[41686]: 2024-05-25T05:10:51.951+0000 7f642b081700 -1 osd.3 0 waiting for initial osdmap 2024-05-25T05:10:51.980 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:10:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3[41686]: 2024-05-25T05:10:51.955+0000 7f6425a18700 -1 osd.3 25 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:10:52.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[24736]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[24736]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[24736]: osdmap e25: 4 total, 3 up, 4 in 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[29649]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[29649]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[29649]: osdmap e25: 4 total, 3 up, 4 in 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:52.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:52 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:52.858 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_4 2024-05-25T05:10:52.858 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_4 bs=1M count=10 conv=fsync 2024-05-25T05:10:52.858 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-25T05:10:52.858 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-25T05:10:52.858 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00808553 s, 1.3 GB/s 2024-05-25T05:10:52.858 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-25T05:10:52.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:52 smithi136 ceph-mon[25618]: pgmap v91: 1 pgs: 1 active+clean; 577 KiB data, 19 MiB used, 268 GiB / 268 GiB avail 2024-05-25T05:10:52.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:52 smithi136 ceph-mon[25618]: from='osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858]' entity='osd.3' cmd='[{"prefix": "osd crush create-or-move", "id": 3, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]': finished 2024-05-25T05:10:52.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:52 smithi136 ceph-mon[25618]: osdmap e25: 4 total, 3 up, 4 in 2024-05-25T05:10:52.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:52 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:52.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:52 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:53.464 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_4 2024-05-25T05:10:54.066 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:53 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:10:54.066 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:53 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:10:54.066 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:53 smithi136 ceph-mon[25618]: osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858] boot 2024-05-25T05:10:54.066 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:53 smithi136 ceph-mon[25618]: osdmap e26: 4 total, 4 up, 4 in 2024-05-25T05:10:54.066 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:53 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:54.067 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:53 smithi136 ceph-mon[25618]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:10:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:10:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[24736]: osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858] boot 2024-05-25T05:10:54.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[24736]: osdmap e26: 4 total, 4 up, 4 in 2024-05-25T05:10:54.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:54.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[24736]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:54.309 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:10:54] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:10:54.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:10:54.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:10:54.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[29649]: osd.3 [v2:172.21.15.88:6826/2889452858,v1:172.21.15.88:6827/2889452858] boot 2024-05-25T05:10:54.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[29649]: osdmap e26: 4 total, 4 up, 4 in 2024-05-25T05:10:54.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:10:54.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:53 smithi088 ceph-mon[29649]: pgmap v94: 1 pgs: 1 active+clean; 577 KiB data, 24 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:54 smithi136 ceph-mon[25618]: osdmap e27: 4 total, 4 up, 4 in 2024-05-25T05:10:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:54 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi088 2024-05-25T05:10:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:55.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[24736]: osdmap e27: 4 total, 4 up, 4 in 2024-05-25T05:10:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi088 2024-05-25T05:10:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[29649]: osdmap e27: 4 total, 4 up, 4 in 2024-05-25T05:10:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi088 2024-05-25T05:10:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:10:56.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[24736]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[24736]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[29649]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[29649]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:55 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:55 smithi136 ceph-mon[25618]: pgmap v96: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:55 smithi136 ceph-mon[25618]: from='client.24200 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_4", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:10:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:55 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:10:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:55 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:10:56.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:55 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:10:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:58 smithi136 ceph-mon[25618]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:58.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:58 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/2086616610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]: dispatch 2024-05-25T05:10:58.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:58 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]: dispatch 2024-05-25T05:10:58.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:58 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]': finished 2024-05-25T05:10:58.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:58 smithi136 ceph-mon[25618]: osdmap e28: 5 total, 4 up, 5 in 2024-05-25T05:10:58.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:58 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:10:58.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[24736]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/2086616610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]: dispatch 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]: dispatch 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]': finished 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[24736]: osdmap e28: 5 total, 4 up, 5 in 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[29649]: pgmap v97: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/2086616610' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]: dispatch 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]: dispatch 2024-05-25T05:10:58.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "b4cde1e9-7947-45f9-b572-7e2a0df3e470"}]': finished 2024-05-25T05:10:58.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[29649]: osdmap e28: 5 total, 4 up, 5 in 2024-05-25T05:10:58.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:58 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:10:59.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:10:59 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/1419373966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:59.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:10:59 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/1419373966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:10:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:10:59 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/1419373966' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:11:00.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:10:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:10:59] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:00 smithi136 ceph-mon[25618]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:00.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:00.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:00 smithi088 ceph-mon[24736]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:00.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:00.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:00 smithi088 ceph-mon[29649]: pgmap v99: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:02.527 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:02 smithi136 ceph-mon[25618]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:02.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:02 smithi088 ceph-mon[29649]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:02 smithi088 ceph-mon[24736]: pgmap v100: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:04.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:04 smithi088 ceph-mon[29649]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:04.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:04 smithi088 ceph-mon[24736]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:04.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:04 smithi136 ceph-mon[25618]: pgmap v101: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:05.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:05 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-25T05:11:05.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:05 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:05.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:05 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-25T05:11:05.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:05 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:05.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:05 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-25T05:11:05.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:05 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:06.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:06 smithi136 ceph-mon[25618]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:06.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:06 smithi136 ceph-mon[25618]: Deploying daemon osd.4 on smithi136 2024-05-25T05:11:06.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:06 smithi088 ceph-mon[29649]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:06 smithi088 ceph-mon[29649]: Deploying daemon osd.4 on smithi136 2024-05-25T05:11:06.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:06 smithi088 ceph-mon[24736]: pgmap v102: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:06.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:06 smithi088 ceph-mon[24736]: Deploying daemon osd.4 on smithi136 2024-05-25T05:11:08.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:08 smithi088 ceph-mon[29649]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:08.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:08 smithi088 ceph-mon[24736]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:08.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:08 smithi136 ceph-mon[25618]: pgmap v103: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:10.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:10 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:11:10 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:11:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: pgmap v104: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:10.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:10 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:12.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:12 smithi136 ceph-mon[25618]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:12.591 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 4 on host 'smithi136' 2024-05-25T05:11:12.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:12 smithi088 ceph-mon[24736]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:12.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:12 smithi088 ceph-mon[29649]: pgmap v105: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:13.157 DEBUG:teuthology.orchestra.run.smithi136:osd.4> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.4.service 2024-05-25T05:11:13.160 INFO:tasks.cephadm:Deploying osd.5 on smithi136 with /dev/vg_nvme/lv_3... 2024-05-25T05:11:13.160 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_3 2024-05-25T05:11:13.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi136 to 16064M 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-25T05:11:13.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:13 smithi136 ceph-mon[25618]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi136 to 16064M 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[24736]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi136 to 16064M 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022]' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-25T05:11:14.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:13 smithi088 ceph-mon[29649]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]: dispatch 2024-05-25T05:11:15.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[24736]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[24736]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[24736]: osdmap e29: 5 total, 4 up, 5 in 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[24736]: from='osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[24736]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[29649]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[29649]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[29649]: osdmap e29: 5 total, 4 up, 5 in 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[29649]: from='osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:15.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:14 smithi088 ceph-mon[29649]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:14 smithi136 ceph-mon[25618]: pgmap v106: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:15.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:14 smithi136 ceph-mon[25618]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["4"]}]': finished 2024-05-25T05:11:15.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:14 smithi136 ceph-mon[25618]: osdmap e29: 5 total, 4 up, 5 in 2024-05-25T05:11:15.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:14 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:14 smithi136 ceph-mon[25618]: from='osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022]' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:15.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:14 smithi136 ceph-mon[25618]: from='osd.4 ' entity='osd.4' cmd=[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:15.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:11:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:11:14.659+0000 7f58faf7b700 -1 osd.4 0 waiting for initial osdmap 2024-05-25T05:11:15.135 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:11:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:11:14.663+0000 7f58f6113700 -1 osd.4 30 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:11:15.144 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_3 2024-05-25T05:11:15.144 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_3 bs=1M count=10 conv=fsync 2024-05-25T05:11:15.144 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-25T05:11:15.144 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-25T05:11:15.144 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00859049 s, 1.2 GB/s 2024-05-25T05:11:15.144 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-25T05:11:15.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:15 smithi136 ceph-mon[25618]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:15.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:15 smithi136 ceph-mon[25618]: osdmap e30: 5 total, 4 up, 5 in 2024-05-25T05:11:15.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:15 smithi136 ceph-mon[25618]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:15.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:15 smithi136 ceph-mon[25618]: osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022] boot 2024-05-25T05:11:15.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:15 smithi136 ceph-mon[25618]: osdmap e31: 5 total, 5 up, 5 in 2024-05-25T05:11:15.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:15 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.763 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_3 2024-05-25T05:11:15.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[29649]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:15.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[29649]: osdmap e30: 5 total, 4 up, 5 in 2024-05-25T05:11:15.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[29649]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:15.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[29649]: osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022] boot 2024-05-25T05:11:15.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[29649]: osdmap e31: 5 total, 5 up, 5 in 2024-05-25T05:11:15.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[24736]: from='osd.4 ' entity='osd.4' cmd='[{"prefix": "osd crush create-or-move", "id": 4, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:15.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[24736]: osdmap e30: 5 total, 4 up, 5 in 2024-05-25T05:11:15.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:15.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[24736]: pgmap v109: 1 pgs: 1 active+clean; 577 KiB data, 23 MiB used, 358 GiB / 358 GiB avail 2024-05-25T05:11:15.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[24736]: osd.4 [v2:172.21.15.136:6800/719773022,v1:172.21.15.136:6801/719773022] boot 2024-05-25T05:11:15.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[24736]: osdmap e31: 5 total, 5 up, 5 in 2024-05-25T05:11:15.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:15 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:11:16.991 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:16 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:11:16.991 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:16 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:11:16.991 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:16 smithi136 ceph-mon[25618]: osdmap e32: 5 total, 5 up, 5 in 2024-05-25T05:11:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:16 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:11:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:16 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:11:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:16 smithi088 ceph-mon[29649]: osdmap e32: 5 total, 5 up, 5 in 2024-05-25T05:11:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:16 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:11:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:16 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:11:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:16 smithi088 ceph-mon[24736]: osdmap e32: 5 total, 5 up, 5 in 2024-05-25T05:11:17.971 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:17 smithi136 ceph-mon[25618]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:17.971 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:17 smithi136 ceph-mon[25618]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:11:17.971 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:11:17.971 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:11:17.971 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:17.971 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:17 smithi136 ceph-mon[25618]: osdmap e33: 5 total, 5 up, 5 in 2024-05-25T05:11:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[29649]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[29649]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:11:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:11:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:11:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:18.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[29649]: osdmap e33: 5 total, 5 up, 5 in 2024-05-25T05:11:18.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[24736]: pgmap v112: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:18.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[24736]: from='client.24227 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_3", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:11:18.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:11:18.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:11:18.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:18.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:17 smithi088 ceph-mon[24736]: osdmap e33: 5 total, 5 up, 5 in 2024-05-25T05:11:19.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:19 smithi088 ceph-mon[29649]: osdmap e34: 5 total, 5 up, 5 in 2024-05-25T05:11:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:19 smithi088 ceph-mon[24736]: osdmap e34: 5 total, 5 up, 5 in 2024-05-25T05:11:19.860 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:19 smithi136 ceph-mon[25618]: osdmap e34: 5 total, 5 up, 5 in 2024-05-25T05:11:20.279 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:11:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:11:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:20.279 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:11:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:11:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: osdmap e35: 5 total, 5 up, 5 in 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/2812102696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]: dispatch 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]: dispatch 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]': finished 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: osdmap e36: 6 total, 5 up, 6 in 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:20.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/3152509300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: osdmap e35: 5 total, 5 up, 5 in 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/2812102696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]: dispatch 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]: dispatch 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]': finished 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: osdmap e36: 6 total, 5 up, 6 in 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:20.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:20.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:20.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:20 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/3152509300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:11:20.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: pgmap v115: 1 pgs: 1 remapped+peering; 577 KiB data, 28 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: osdmap e35: 5 total, 5 up, 5 in 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/2812102696' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]: dispatch 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]: dispatch 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "329f387d-fa0d-4691-b553-a10e65cba34f"}]': finished 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: osdmap e36: 6 total, 5 up, 6 in 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:20.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:20 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/3152509300' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:11:21.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:21 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi136 2024-05-25T05:11:21.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:21 smithi088 ceph-mon[24736]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:21.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:21 smithi088 ceph-mon[24736]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:21.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:21 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi136 2024-05-25T05:11:21.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:21 smithi088 ceph-mon[29649]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:21.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:21 smithi088 ceph-mon[29649]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:21.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:21 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi136 2024-05-25T05:11:21.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:21 smithi136 ceph-mon[25618]: pgmap v118: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:21.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:21 smithi136 ceph-mon[25618]: pgmap v119: 1 pgs: 1 remapped+peering; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:23.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:23 smithi136 ceph-mon[25618]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-05-25T05:11:23.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:11:23.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:11:23.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:23 smithi088 ceph-mon[24736]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-05-25T05:11:23.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:11:23.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:11:23.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:23 smithi088 ceph-mon[29649]: pgmap v120: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 136 KiB/s, 0 objects/s recovering 2024-05-25T05:11:23.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:11:23.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:11:25.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:25 smithi088 ceph-mon[24736]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-05-25T05:11:25.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:25 smithi088 ceph-mon[29649]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-05-25T05:11:25.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:25 smithi136 ceph-mon[25618]: pgmap v121: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 99 KiB/s, 0 objects/s recovering 2024-05-25T05:11:27.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:27 smithi088 ceph-mon[24736]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-25T05:11:27.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:27 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-25T05:11:27.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:27 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:27 smithi088 ceph-mon[29649]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-25T05:11:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:27 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-25T05:11:27.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:27 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:27 smithi136 ceph-mon[25618]: pgmap v122: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 76 KiB/s, 0 objects/s recovering 2024-05-25T05:11:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:27 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-25T05:11:27.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:27 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:28.758 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:28 smithi088 ceph-mon[29649]: Deploying daemon osd.5 on smithi136 2024-05-25T05:11:28.759 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:28 smithi088 ceph-mon[24736]: Deploying daemon osd.5 on smithi136 2024-05-25T05:11:28.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:28 smithi136 ceph-mon[25618]: Deploying daemon osd.5 on smithi136 2024-05-25T05:11:29.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:29 smithi136 ceph-mon[25618]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-25T05:11:29.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:29 smithi088 ceph-mon[24736]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-25T05:11:29.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:29 smithi088 ceph-mon[29649]: pgmap v123: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 60 KiB/s, 0 objects/s recovering 2024-05-25T05:11:30.788 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:11:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:11:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:31.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:31 smithi136 ceph-mon[25618]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-05-25T05:11:31.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:31 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:31.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:31 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:32.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:31 smithi088 ceph-mon[24736]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-05-25T05:11:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:31 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:31 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:31 smithi088 ceph-mon[29649]: pgmap v124: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 50 KiB/s, 0 objects/s recovering 2024-05-25T05:11:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:31 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:31 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:32.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:32.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:32.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:32.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:32.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:32 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:33.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:33.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:32 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:33.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:33 smithi136 ceph-mon[25618]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 43 KiB/s, 0 objects/s recovering 2024-05-25T05:11:34.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:33 smithi088 ceph-mon[29649]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 43 KiB/s, 0 objects/s recovering 2024-05-25T05:11:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:33 smithi088 ceph-mon[24736]: pgmap v125: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail; 43 KiB/s, 0 objects/s recovering 2024-05-25T05:11:34.206 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 5 on host 'smithi136' 2024-05-25T05:11:34.817 DEBUG:teuthology.orchestra.run.smithi136:osd.5> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.5.service 2024-05-25T05:11:34.819 INFO:tasks.cephadm:Deploying osd.6 on smithi136 with /dev/vg_nvme/lv_2... 2024-05-25T05:11:34.819 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_2 2024-05-25T05:11:35.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:35.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:35.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:35.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:35.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:35.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi136 to 8032M 2024-05-25T05:11:35.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:35.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-25T05:11:35.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:35 smithi136 ceph-mon[25618]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi136 to 8032M 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[29649]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi136 to 8032M 2024-05-25T05:11:35.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:35.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: pgmap v126: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:35.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580]' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-25T05:11:35.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:35 smithi088 ceph-mon[24736]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]: dispatch 2024-05-25T05:11:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:36 smithi136 ceph-mon[25618]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-25T05:11:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:36 smithi136 ceph-mon[25618]: osdmap e37: 6 total, 5 up, 6 in 2024-05-25T05:11:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:36 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:36 smithi136 ceph-mon[25618]: from='osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:36.377 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:36 smithi136 ceph-mon[25618]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:36.378 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:11:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:11:36.267+0000 7f537e690700 -1 osd.5 0 waiting for initial osdmap 2024-05-25T05:11:36.378 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:11:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:11:36.272+0000 7f537a029700 -1 osd.5 38 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[29649]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[29649]: osdmap e37: 6 total, 5 up, 6 in 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[29649]: from='osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[29649]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[24736]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["5"]}]': finished 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[24736]: osdmap e37: 6 total, 5 up, 6 in 2024-05-25T05:11:36.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:36.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[24736]: from='osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580]' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:36.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:36 smithi088 ceph-mon[24736]: from='osd.5 ' entity='osd.5' cmd=[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:36.854 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_2 2024-05-25T05:11:36.854 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_2 bs=1M count=10 conv=fsync 2024-05-25T05:11:36.854 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-25T05:11:36.855 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-25T05:11:36.855 INFO:teuthology.orchestra.run.smithi136.stderr:10485760 bytes (10 MB, 10 MiB) copied, 0.00976832 s, 1.1 GB/s 2024-05-25T05:11:36.855 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-25T05:11:37.397 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_2 2024-05-25T05:11:37.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[24736]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[24736]: osdmap e38: 6 total, 5 up, 6 in 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[24736]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[24736]: osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580] boot 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[24736]: osdmap e39: 6 total, 6 up, 6 in 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[29649]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[29649]: osdmap e38: 6 total, 5 up, 6 in 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[29649]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[29649]: osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580] boot 2024-05-25T05:11:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[29649]: osdmap e39: 6 total, 6 up, 6 in 2024-05-25T05:11:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:37 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:37.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:37 smithi136 ceph-mon[25618]: from='osd.5 ' entity='osd.5' cmd='[{"prefix": "osd crush create-or-move", "id": 5, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:37 smithi136 ceph-mon[25618]: osdmap e38: 6 total, 5 up, 6 in 2024-05-25T05:11:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:37 smithi136 ceph-mon[25618]: pgmap v129: 1 pgs: 1 active+clean; 577 KiB data, 29 MiB used, 447 GiB / 447 GiB avail 2024-05-25T05:11:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:37 smithi136 ceph-mon[25618]: osd.5 [v2:172.21.15.136:6808/3520847580,v1:172.21.15.136:6809/3520847580] boot 2024-05-25T05:11:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:37 smithi136 ceph-mon[25618]: osdmap e39: 6 total, 6 up, 6 in 2024-05-25T05:11:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:37 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:11:38.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:38 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:11:38.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:38 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:11:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:38 smithi088 ceph-mon[24736]: osdmap e40: 6 total, 6 up, 6 in 2024-05-25T05:11:38.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:38 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:11:38.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:38 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:11:38.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:38 smithi088 ceph-mon[29649]: osdmap e40: 6 total, 6 up, 6 in 2024-05-25T05:11:38.612 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:38 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:11:38.612 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:38 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:11:38.613 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:38 smithi136 ceph-mon[25618]: osdmap e40: 6 total, 6 up, 6 in 2024-05-25T05:11:39.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:39 smithi136 ceph-mon[25618]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:39.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:39 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:11:39.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:39 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:11:39.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:39 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:39.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:39 smithi136 ceph-mon[25618]: osdmap e41: 6 total, 6 up, 6 in 2024-05-25T05:11:39.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:39 smithi136 ceph-mon[25618]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-25T05:11:39.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[24736]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[24736]: osdmap e41: 6 total, 6 up, 6 in 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[24736]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[29649]: pgmap v132: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:39.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[29649]: osdmap e41: 6 total, 6 up, 6 in 2024-05-25T05:11:39.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:39 smithi088 ceph-mon[29649]: Health check failed: Reduced data availability: 1 pg peering (PG_AVAILABILITY) 2024-05-25T05:11:40.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:40 smithi136 ceph-mon[25618]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:11:40.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.560 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.560 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:40.560 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:40.560 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:40.560 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:40 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:11:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:11:40] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[29649]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[24736]: from='client.24254 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_2", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:11:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:40 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:41.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:41 smithi136 ceph-mon[25618]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:41.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:41 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi136 2024-05-25T05:11:41.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:41 smithi136 ceph-mon[25618]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:41.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:41 smithi136 ceph-mon[25618]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:11:41.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:41 smithi136 ceph-mon[25618]: osdmap e42: 6 total, 6 up, 6 in 2024-05-25T05:11:41.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[24736]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:41.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi136 2024-05-25T05:11:41.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[24736]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:41.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[24736]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:11:41.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[24736]: osdmap e42: 6 total, 6 up, 6 in 2024-05-25T05:11:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[29649]: pgmap v134: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi136 2024-05-25T05:11:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[29649]: pgmap v135: 1 pgs: 1 remapped+peering; 577 KiB data, 34 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[29649]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:11:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:41 smithi088 ceph-mon[29649]: osdmap e42: 6 total, 6 up, 6 in 2024-05-25T05:11:42.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[29649]: osdmap e43: 6 total, 6 up, 6 in 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/2845322543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]: dispatch 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]: dispatch 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]': finished 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[29649]: osdmap e44: 7 total, 6 up, 7 in 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/4293797126' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[24736]: osdmap e43: 6 total, 6 up, 6 in 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/2845322543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]: dispatch 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]: dispatch 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]': finished 2024-05-25T05:11:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[24736]: osdmap e44: 7 total, 6 up, 7 in 2024-05-25T05:11:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:42 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/4293797126' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:11:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:42 smithi136 ceph-mon[25618]: osdmap e43: 6 total, 6 up, 6 in 2024-05-25T05:11:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:42 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/2845322543' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]: dispatch 2024-05-25T05:11:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:42 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]: dispatch 2024-05-25T05:11:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:42 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "c3338af4-af10-4b5d-9107-2cd6f0e30ea2"}]': finished 2024-05-25T05:11:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:42 smithi136 ceph-mon[25618]: osdmap e44: 7 total, 6 up, 7 in 2024-05-25T05:11:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:42 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:42 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/4293797126' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:11:43.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:11:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:11:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 165 KiB/s, 0 objects/s recovering 2024-05-25T05:11:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-25T05:11:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 165 KiB/s, 0 objects/s recovering 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:43.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:43.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:43 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: pgmap v139: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 165 KiB/s, 0 objects/s recovering 2024-05-25T05:11:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 1 pg peering) 2024-05-25T05:11:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:43 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:44.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:44 smithi136 ceph-mon[25618]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-05-25T05:11:44.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:44 smithi136 ceph-mon[25618]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:11:44.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:44 smithi136 ceph-mon[25618]: Cluster is now healthy 2024-05-25T05:11:44.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:44 smithi088 ceph-mon[24736]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-05-25T05:11:44.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:44 smithi088 ceph-mon[24736]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:11:44.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:44 smithi088 ceph-mon[24736]: Cluster is now healthy 2024-05-25T05:11:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:44 smithi088 ceph-mon[29649]: pgmap v140: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 166 KiB/s, 0 objects/s recovering 2024-05-25T05:11:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:44 smithi088 ceph-mon[29649]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:11:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:44 smithi088 ceph-mon[29649]: Cluster is now healthy 2024-05-25T05:11:46.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:46 smithi136 ceph-mon[25618]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-25T05:11:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:46 smithi088 ceph-mon[24736]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-25T05:11:46.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:46 smithi088 ceph-mon[29649]: pgmap v141: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 103 KiB/s, 0 objects/s recovering 2024-05-25T05:11:48.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:48 smithi136 ceph-mon[25618]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-25T05:11:48.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:48 smithi088 ceph-mon[24736]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-25T05:11:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:48 smithi088 ceph-mon[29649]: pgmap v142: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 75 KiB/s, 0 objects/s recovering 2024-05-25T05:11:49.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:49 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-25T05:11:49.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:49 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:49 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-25T05:11:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:49 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:49.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:49 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-25T05:11:49.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:49 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:50 smithi136 ceph-mon[25618]: Deploying daemon osd.6 on smithi136 2024-05-25T05:11:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:50 smithi136 ceph-mon[25618]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-25T05:11:50.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:11:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:11:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:11:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:50 smithi088 ceph-mon[29649]: Deploying daemon osd.6 on smithi136 2024-05-25T05:11:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:50 smithi088 ceph-mon[29649]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-25T05:11:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:50 smithi088 ceph-mon[24736]: Deploying daemon osd.6 on smithi136 2024-05-25T05:11:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:50 smithi088 ceph-mon[24736]: pgmap v143: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 65 KiB/s, 0 objects/s recovering 2024-05-25T05:11:51.719 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:51 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:51.719 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:51 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:52.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:51 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:51 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:52.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:51 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:52.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:51 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:52.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:52 smithi136 ceph-mon[25618]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-25T05:11:53.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:52 smithi088 ceph-mon[24736]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-25T05:11:53.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:52 smithi088 ceph-mon[29649]: pgmap v144: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail; 52 KiB/s, 0 objects/s recovering 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[29649]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[24736]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:54.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:54 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:54.872 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:54 smithi136 ceph-mon[25618]: pgmap v145: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:54.872 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:54.872 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:54.872 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:54.872 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:54.872 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:54 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:56.493 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 6 on host 'smithi136' 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:56.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:56.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:56.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:56.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:56.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:56 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: pgmap v146: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:56.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:56.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:11:56.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:11:56.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:11:56.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:56.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:56 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:11:57.187 DEBUG:teuthology.orchestra.run.smithi136:osd.6> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.6.service 2024-05-25T05:11:57.190 INFO:tasks.cephadm:Deploying osd.7 on smithi136 with /dev/vg_nvme/lv_1... 2024-05-25T05:11:57.190 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph-volume lvm zap /dev/vg_nvme/lv_1 2024-05-25T05:11:57.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi136 to 5354M 2024-05-25T05:11:57.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[29649]: from='osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[29649]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi136 to 5354M 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[24736]: from='osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-25T05:11:57.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:57 smithi088 ceph-mon[24736]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-25T05:11:57.810 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:57 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi136 to 5354M 2024-05-25T05:11:57.810 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:57 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:57.810 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:57 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:11:57.811 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:57 smithi136 ceph-mon[25618]: from='osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252]' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-25T05:11:57.811 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:57 smithi136 ceph-mon[25618]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]: dispatch 2024-05-25T05:11:58.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:58 smithi136 ceph-mon[25618]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:58.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:58 smithi136 ceph-mon[25618]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-25T05:11:58.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:58 smithi136 ceph-mon[25618]: osdmap e45: 7 total, 6 up, 7 in 2024-05-25T05:11:58.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:58 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:58.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:58 smithi136 ceph-mon[25618]: from='osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:58.667 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:58 smithi136 ceph-mon[25618]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:58.668 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:11:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:11:58.541+0000 7fd0b5f60700 -1 osd.6 0 waiting for initial osdmap 2024-05-25T05:11:58.668 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:11:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:11:58.549+0000 7fd0af0f4700 -1 osd.6 46 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:11:58.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[29649]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[29649]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[29649]: osdmap e45: 7 total, 6 up, 7 in 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[29649]: from='osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[29649]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[24736]: pgmap v147: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[24736]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["6"]}]': finished 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[24736]: osdmap e45: 7 total, 6 up, 7 in 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[24736]: from='osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252]' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:58 smithi088 ceph-mon[24736]: from='osd.6 ' entity='osd.6' cmd=[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:11:59.191 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping: /dev/vg_nvme/lv_1 2024-05-25T05:11:59.191 INFO:teuthology.orchestra.run.smithi136.stderr:Running command: /usr/bin/dd if=/dev/zero of=/dev/vg_nvme/lv_1 bs=1M count=10 conv=fsync 2024-05-25T05:11:59.191 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10+0 records in 2024-05-25T05:11:59.191 INFO:teuthology.orchestra.run.smithi136.stderr:10+0 records out 2024-05-25T05:11:59.191 INFO:teuthology.orchestra.run.smithi136.stderr: stderr: 10485760 bytes (10 MB, 10 MiB) copied, 0.011 s, 953 MB/s 2024-05-25T05:11:59.191 INFO:teuthology.orchestra.run.smithi136.stderr:--> Zapping successful for: 2024-05-25T05:11:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[29649]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[29649]: osdmap e46: 7 total, 6 up, 7 in 2024-05-25T05:11:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[24736]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[24736]: osdmap e46: 7 total, 6 up, 7 in 2024-05-25T05:11:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:11:59 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:59 smithi136 ceph-mon[25618]: from='osd.6 ' entity='osd.6' cmd='[{"prefix": "osd crush create-or-move", "id": 6, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:11:59.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:59 smithi136 ceph-mon[25618]: osdmap e46: 7 total, 6 up, 7 in 2024-05-25T05:11:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:59 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:59 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:11:59 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:11:59.940 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch daemon add osd smithi136:vg_nvme/lv_1 2024-05-25T05:12:00.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[29649]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[29649]: osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252] boot 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[29649]: osdmap e47: 7 total, 7 up, 7 in 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[29649]: osdmap e48: 7 total, 7 up, 7 in 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:12:00.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[24736]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:12:00.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[24736]: osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252] boot 2024-05-25T05:12:00.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[24736]: osdmap e47: 7 total, 7 up, 7 in 2024-05-25T05:12:00.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:12:00.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:00 smithi088 ceph-mon[24736]: osdmap e48: 7 total, 7 up, 7 in 2024-05-25T05:12:00.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:00 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:12:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:00 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:12:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:00 smithi136 ceph-mon[25618]: pgmap v150: 1 pgs: 1 active+clean; 577 KiB data, 35 MiB used, 536 GiB / 536 GiB avail 2024-05-25T05:12:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:00 smithi136 ceph-mon[25618]: osd.6 [v2:172.21.15.136:6816/4246335252,v1:172.21.15.136:6817/4246335252] boot 2024-05-25T05:12:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:00 smithi136 ceph-mon[25618]: osdmap e47: 7 total, 7 up, 7 in 2024-05-25T05:12:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:00 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:12:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:00 smithi136 ceph-mon[25618]: osdmap e48: 7 total, 7 up, 7 in 2024-05-25T05:12:02.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[24736]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[24736]: osdmap e49: 7 total, 7 up, 7 in 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[29649]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[29649]: osdmap e49: 7 total, 7 up, 7 in 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:12:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:02 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:02.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:02 smithi136 ceph-mon[25618]: pgmap v153: 1 pgs: 1 active+clean; 577 KiB data, 40 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:02.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:02 smithi136 ceph-mon[25618]: osdmap e49: 7 total, 7 up, 7 in 2024-05-25T05:12:02.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd tree", "states": ["destroyed"], "format": "json"}]: dispatch 2024-05-25T05:12:02.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.bootstrap-osd"}]: dispatch 2024-05-25T05:12:02.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:02 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:03.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:12:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: osdmap e50: 7 total, 7 up, 7 in 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: osdmap e50: 7 total, 7 up, 7 in 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:03 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: from='client.24281 -' entity='client.admin' cmd=[{"prefix": "orch daemon add osd", "svc_arg": "smithi136:vg_nvme/lv_1", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: osdmap e50: 7 total, 7 up, 7 in 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:03.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:03 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:04.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-25T05:12:04.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi136 2024-05-25T05:12:04.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-25T05:12:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:12:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: osdmap e51: 7 total, 7 up, 7 in 2024-05-25T05:12:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/2240865618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]: dispatch 2024-05-25T05:12:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]: dispatch 2024-05-25T05:12:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]': finished 2024-05-25T05:12:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: osdmap e52: 8 total, 7 up, 8 in 2024-05-25T05:12:04.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:04 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi136 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: osdmap e51: 7 total, 7 up, 7 in 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/2240865618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]: dispatch 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]: dispatch 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]': finished 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: osdmap e52: 8 total, 7 up, 8 in 2024-05-25T05:12:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: pgmap v156: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 129 KiB/s, 0 objects/s recovering 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi136 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: pgmap v157: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: osdmap e51: 7 total, 7 up, 7 in 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/2240865618' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]: dispatch 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd=[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]: dispatch 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: from='client.? ' entity='client.bootstrap-osd' cmd='[{"prefix": "osd new", "uuid": "612900ea-482c-4db2-bd28-903c800ee2d8"}]': finished 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: osdmap e52: 8 total, 7 up, 8 in 2024-05-25T05:12:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:04 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:05 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/3191276306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:12:05.897 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:05 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/3191276306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:12:05.897 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:05 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/3191276306' entity='client.bootstrap-osd' cmd=[{"prefix": "mon getmap"}]: dispatch 2024-05-25T05:12:06.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:12:05] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:12:06.875 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[24736]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[29649]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:06.876 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:06.877 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:06.877 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:06 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:06 smithi136 ceph-mon[25618]: pgmap v160: 1 pgs: 1 active+undersized+remapped; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail; 130 KiB/s, 0 objects/s recovering 2024-05-25T05:12:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:06 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:07.578 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:07 smithi136 ceph-mon[25618]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:07.578 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:07 smithi136 ceph-mon[25618]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:12:07.579 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:07 smithi136 ceph-mon[25618]: Cluster is now healthy 2024-05-25T05:12:08.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:07 smithi088 ceph-mon[24736]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:07 smithi088 ceph-mon[24736]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:12:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:07 smithi088 ceph-mon[24736]: Cluster is now healthy 2024-05-25T05:12:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:07 smithi088 ceph-mon[29649]: pgmap v161: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:07 smithi088 ceph-mon[29649]: Health check cleared: CEPHADM_STRAY_DAEMON (was: 1 stray daemon(s) not managed by cephadm) 2024-05-25T05:12:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:07 smithi088 ceph-mon[29649]: Cluster is now healthy 2024-05-25T05:12:09.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:09 smithi088 ceph-mon[24736]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:09.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:09 smithi088 ceph-mon[29649]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:09 smithi136 ceph-mon[25618]: pgmap v162: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:10.904 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:10 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:12:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:12:11.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[29649]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[24736]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-25T05:12:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:11 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:11.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:11 smithi136 ceph-mon[25618]: pgmap v163: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:11.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:11.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:11.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-25T05:12:11.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:11 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:12.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:12 smithi136 ceph-mon[25618]: Deploying daemon osd.7 on smithi136 2024-05-25T05:12:12.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:12 smithi088 ceph-mon[24736]: Deploying daemon osd.7 on smithi136 2024-05-25T05:12:12.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:12 smithi088 ceph-mon[29649]: Deploying daemon osd.7 on smithi136 2024-05-25T05:12:13.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:13 smithi136 ceph-mon[25618]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:13 smithi088 ceph-mon[24736]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:13 smithi088 ceph-mon[29649]: pgmap v164: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:15 smithi136 ceph-mon[25618]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:15 smithi088 ceph-mon[24736]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:15 smithi088 ceph-mon[29649]: pgmap v165: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:17 smithi136 ceph-mon[25618]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:17.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:17 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:17.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[29649]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[24736]: pgmap v166: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:17.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:17 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.120 INFO:teuthology.orchestra.run.smithi136.stdout:Created osd(s) 7 on host 'smithi136' 2024-05-25T05:12:19.693 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.694 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-25T05:12:19.695 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:19 smithi136 ceph-mon[25618]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-25T05:12:19.716 DEBUG:teuthology.orchestra.run.smithi136:osd.7> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.7.service 2024-05-25T05:12:19.718 INFO:tasks.cephadm:Waiting for 8 OSDs to come up... 2024-05-25T05:12:19.719 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[24736]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: pgmap v167: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.4", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.5", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.6", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd.7", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:19.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:19.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250]' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-25T05:12:19.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:19 smithi088 ceph-mon[29649]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]: dispatch 2024-05-25T05:12:20.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[29649]: Adjusting osd_memory_target on smithi136 to 4016M 2024-05-25T05:12:20.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[29649]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-25T05:12:20.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[29649]: osdmap e53: 8 total, 7 up, 8 in 2024-05-25T05:12:20.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:20.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[29649]: from='osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:12:20.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[29649]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:12:20.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[24736]: Adjusting osd_memory_target on smithi136 to 4016M 2024-05-25T05:12:20.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[24736]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-25T05:12:20.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[24736]: osdmap e53: 8 total, 7 up, 8 in 2024-05-25T05:12:20.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:20.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[24736]: from='osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:12:20.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:20 smithi088 ceph-mon[24736]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:12:20.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:20 smithi136 ceph-mon[25618]: Adjusting osd_memory_target on smithi136 to 4016M 2024-05-25T05:12:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:20 smithi136 ceph-mon[25618]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["7"]}]': finished 2024-05-25T05:12:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:20 smithi136 ceph-mon[25618]: osdmap e53: 8 total, 7 up, 8 in 2024-05-25T05:12:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:20 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:20 smithi136 ceph-mon[25618]: from='osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250]' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:12:20.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:20 smithi136 ceph-mon[25618]: from='osd.7 ' entity='osd.7' cmd=[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]: dispatch 2024-05-25T05:12:21.516 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:12:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:12:21.182+0000 7f65580c3700 -1 osd.7 0 waiting for initial osdmap 2024-05-25T05:12:21.517 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:12:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:12:21.190+0000 7f6552259700 -1 osd.7 54 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:12:21.714 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:12:21.714 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[24736]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:21.714 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[24736]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:12:21.714 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[24736]: osdmap e54: 8 total, 7 up, 8 in 2024-05-25T05:12:21.714 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:21.714 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:21.715 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[29649]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:21.715 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[29649]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:12:21.715 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[29649]: osdmap e54: 8 total, 7 up, 8 in 2024-05-25T05:12:21.715 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:21.715 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:21 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:21.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:21 smithi136 ceph-mon[25618]: pgmap v168: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:21 smithi136 ceph-mon[25618]: from='osd.7 ' entity='osd.7' cmd='[{"prefix": "osd crush create-or-move", "id": 7, "weight":0.0873, "args": ["host=smithi136", "root=default"]}]': finished 2024-05-25T05:12:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:21 smithi136 ceph-mon[25618]: osdmap e54: 8 total, 7 up, 8 in 2024-05-25T05:12:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:21 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:22.468 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":54,"num_osds":8,"num_up_osds":7,"osd_up_since":1716613919,"num_in_osds":8,"osd_in_since":1716613924,"num_remapped_pgs":0} 2024-05-25T05:12:22.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[24736]: purged_snaps scrub starts 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[24736]: purged_snaps scrub ok 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3772915737' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[24736]: osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250] boot 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[24736]: osdmap e55: 8 total, 8 up, 8 in 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[29649]: purged_snaps scrub starts 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[29649]: purged_snaps scrub ok 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3772915737' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[29649]: osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250] boot 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[29649]: osdmap e55: 8 total, 8 up, 8 in 2024-05-25T05:12:22.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:22 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:22.883 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:22 smithi136 ceph-mon[25618]: purged_snaps scrub starts 2024-05-25T05:12:22.883 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:22 smithi136 ceph-mon[25618]: purged_snaps scrub ok 2024-05-25T05:12:22.883 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:22 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3772915737' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-25T05:12:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:22 smithi136 ceph-mon[25618]: osd.7 [v2:172.21.15.136:6824/366893250,v1:172.21.15.136:6825/366893250] boot 2024-05-25T05:12:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:22 smithi136 ceph-mon[25618]: osdmap e55: 8 total, 8 up, 8 in 2024-05-25T05:12:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:22 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:23.468 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd stat -f json 2024-05-25T05:12:23.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[29649]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:23.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:12:23.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:12:23.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[29649]: osdmap e56: 8 total, 8 up, 8 in 2024-05-25T05:12:23.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[24736]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:23.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:12:23.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:12:23.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:23 smithi088 ceph-mon[24736]: osdmap e56: 8 total, 8 up, 8 in 2024-05-25T05:12:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:23 smithi136 ceph-mon[25618]: pgmap v171: 1 pgs: 1 active+clean; 577 KiB data, 41 MiB used, 626 GiB / 626 GiB avail 2024-05-25T05:12:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:12:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:23 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:12:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:23 smithi136 ceph-mon[25618]: osdmap e56: 8 total, 8 up, 8 in 2024-05-25T05:12:24.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:12:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:12:25.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[24736]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[24736]: osdmap e57: 8 total, 8 up, 8 in 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi136 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[29649]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[29649]: osdmap e57: 8 total, 8 up, 8 in 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi136 2024-05-25T05:12:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:25 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:25.344 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:12:25.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:25 smithi136 ceph-mon[25618]: pgmap v174: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:25.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:25 smithi136 ceph-mon[25618]: osdmap e57: 8 total, 8 up, 8 in 2024-05-25T05:12:25.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:25 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:25.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:25 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi136 2024-05-25T05:12:25.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:25 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:25.935 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":58,"num_osds":8,"num_up_osds":8,"osd_up_since":1716613942,"num_in_osds":8,"osd_in_since":1716613924,"num_remapped_pgs":0} 2024-05-25T05:12:25.935 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-25T05:12:26.146 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:12:26.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:26 smithi136 ceph-mon[25618]: osdmap e58: 8 total, 8 up, 8 in 2024-05-25T05:12:26.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:26 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3617994694' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-25T05:12:26.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:26 smithi088 ceph-mon[29649]: osdmap e58: 8 total, 8 up, 8 in 2024-05-25T05:12:26.499 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:26 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3617994694' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-25T05:12:26.499 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:26 smithi088 ceph-mon[24736]: osdmap e58: 8 total, 8 up, 8 in 2024-05-25T05:12:26.499 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:26 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3617994694' entity='client.admin' cmd=[{"prefix": "osd stat", "format": "json"}]: dispatch 2024-05-25T05:12:27.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:27 smithi088 ceph-mon[29649]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:27.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:27 smithi088 ceph-mon[29649]: osdmap e59: 8 total, 8 up, 8 in 2024-05-25T05:12:27.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:27 smithi088 ceph-mon[24736]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:27.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:27 smithi088 ceph-mon[24736]: osdmap e59: 8 total, 8 up, 8 in 2024-05-25T05:12:27.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:27 smithi136 ceph-mon[25618]: pgmap v177: 1 pgs: 1 remapped+peering; 577 KiB data, 47 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:27.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:27 smithi136 ceph-mon[25618]: osdmap e59: 8 total, 8 up, 8 in 2024-05-25T05:12:27.952 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:12:27.953 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":59,"fsid":"9a885618-1a54-11ef-bc9b-c7b262605968","created":"2024-05-25T05:07:29.070009+0000","modified":"2024-05-25T05:12:26.190072+0000","last_up_change":"2024-05-25T05:12:22.176493+0000","last_in_change":"2024-05-25T05:12:04.129376+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-25T05:10:31.022608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"2870ce62-38d4-45ad-8d11-fad3a2bef386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6803","nonce":1207909643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6805","nonce":1207909643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6809","nonce":1207909643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6807","nonce":1207909643}]},"public_addr":"172.21.15.88:6803/1207909643","cluster_addr":"172.21.15.88:6805/1207909643","heartbeat_back_addr":"172.21.15.88:6809/1207909643","heartbeat_front_addr":"172.21.15.88:6807/1207909643","state":["exists","up"]},{"osd":1,"uuid":"abf35f19-27d1-499d-a7c5-2960d202841a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6811","nonce":1328023184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6813","nonce":1328023184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6817","nonce":1328023184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6815","nonce":1328023184}]},"public_addr":"172.21.15.88:6811/1328023184","cluster_addr":"172.21.15.88:6813/1328023184","heartbeat_back_addr":"172.21.15.88:6817/1328023184","heartbeat_front_addr":"172.21.15.88:6815/1328023184","state":["exists","up"]},{"osd":2,"uuid":"dbc42aa3-f39d-4122-b4df-4510e612e1b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6819","nonce":4166017164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6821","nonce":4166017164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6825","nonce":4166017164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6823","nonce":4166017164}]},"public_addr":"172.21.15.88:6819/4166017164","cluster_addr":"172.21.15.88:6821/4166017164","heartbeat_back_addr":"172.21.15.88:6825/4166017164","heartbeat_front_addr":"172.21.15.88:6823/4166017164","state":["exists","up"]},{"osd":3,"uuid":"aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6827","nonce":2889452858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6829","nonce":2889452858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6833","nonce":2889452858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6831","nonce":2889452858}]},"public_addr":"172.21.15.88:6827/2889452858","cluster_addr":"172.21.15.88:6829/2889452858","heartbeat_back_addr":"172.21.15.88:6833/2889452858","heartbeat_front_addr":"172.21.15.88:6831/2889452858","state":["exists","up"]},{"osd":4,"uuid":"b4cde1e9-7947-45f9-b572-7e2a0df3e470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6801","nonce":719773022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6803","nonce":719773022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6807","nonce":719773022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6805","nonce":719773022}]},"public_addr":"172.21.15.136:6801/719773022","cluster_addr":"172.21.15.136:6803/719773022","heartbeat_back_addr":"172.21.15.136:6807/719773022","heartbeat_front_addr":"172.21.15.136:6805/719773022","state":["exists","up"]},{"osd":5,"uuid":"329f387d-fa0d-4691-b553-a10e65cba34f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6809","nonce":3520847580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6811","nonce":3520847580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6815","nonce":3520847580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6813","nonce":3520847580}]},"public_addr":"172.21.15.136:6809/3520847580","cluster_addr":"172.21.15.136:6811/3520847580","heartbeat_back_addr":"172.21.15.136:6815/3520847580","heartbeat_front_addr":"172.21.15.136:6813/3520847580","state":["exists","up"]},{"osd":6,"uuid":"c3338af4-af10-4b5d-9107-2cd6f0e30ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6817","nonce":4246335252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6819","nonce":4246335252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6823","nonce":4246335252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6821","nonce":4246335252}]},"public_addr":"172.21.15.136:6817/4246335252","cluster_addr":"172.21.15.136:6819/4246335252","heartbeat_back_addr":"172.21.15.136:6823/4246335252","heartbeat_front_addr":"172.21.15.136:6821/4246335252","state":["exists","up"]},{"osd":7,"uuid":"612900ea-482c-4db2-bd28-903c800ee2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6825","nonce":366893250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6827","nonce":366893250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6831","nonce":366893250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6829","nonce":366893250}]},"public_addr":"172.21.15.136:6825/366893250","cluster_addr":"172.21.15.136:6827/366893250","heartbeat_back_addr":"172.21.15.136:6831/366893250","heartbeat_front_addr":"172.21.15.136:6829/366893250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:09:40.914150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:03.298943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:27.052417+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:51.219651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:14.130257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:35.798753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:57.867955+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:12:20.478913+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/685032161":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6801/3566449769":"2024-05-26T05:08:22.665414+0000","172.21.15.88:0/2974971448":"2024-05-26T05:08:22.665414+0000","172.21.15.88:0/3280524365":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/1340989008":"2024-05-26T05:08:00.553776+0000","172.21.15.88:6800/3566449769":"2024-05-26T05:08:22.665414+0000","172.21.15.88:0/2057106370":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/1577678860":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6800/912908121":"2024-05-26T05:08:00.553776+0000","172.21.15.88:6801/912908121":"2024-05-26T05:08:00.553776+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-25T05:12:28.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:28 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/778911037' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:12:28.295 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:28 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/778911037' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:12:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:28 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/778911037' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:12:28.540 INFO:tasks.cephadm.ceph_manager.ceph:[{'pool': 1, 'pool_name': '.mgr', 'create_time': '2024-05-25T05:10:31.022608+0000', 'flags': 1, 'flags_names': 'hashpspool', 'type': 1, 'size': 3, 'min_size': 2, 'crush_rule': 0, 'peering_crush_bucket_count': 0, 'peering_crush_bucket_target': 0, 'peering_crush_bucket_barrier': 0, 'peering_crush_bucket_mandatory_member': 2147483647, 'object_hash': 2, 'pg_autoscale_mode': 'off', 'pg_num': 1, 'pg_placement_num': 1, 'pg_placement_num_target': 1, 'pg_num_target': 1, 'pg_num_pending': 1, 'last_pg_merge_meta': {'source_pgid': '0.0', 'ready_epoch': 0, 'last_epoch_started': 0, 'last_epoch_clean': 0, 'source_version': "0'0", 'target_version': "0'0"}, 'last_change': '22', 'last_force_op_resend': '0', 'last_force_op_resend_prenautilus': '0', 'last_force_op_resend_preluminous': '0', 'auid': 0, 'snap_mode': 'selfmanaged', 'snap_seq': 0, 'snap_epoch': 0, 'pool_snaps': [], 'removed_snaps': '[]', 'quota_max_bytes': 0, 'quota_max_objects': 0, 'tiers': [], 'tier_of': -1, 'read_tier': -1, 'write_tier': -1, 'cache_mode': 'none', 'target_max_bytes': 0, 'target_max_objects': 0, 'cache_target_dirty_ratio_micro': 400000, 'cache_target_dirty_high_ratio_micro': 600000, 'cache_target_full_ratio_micro': 800000, 'cache_min_flush_age': 0, 'cache_min_evict_age': 0, 'erasure_code_profile': '', 'hit_set_params': {'type': 'none'}, 'hit_set_period': 0, 'hit_set_count': 0, 'use_gmt_hitset': True, 'min_read_recency_for_promote': 0, 'min_write_recency_for_promote': 0, 'hit_set_grade_decay_rate': 0, 'hit_set_search_last_n': 0, 'grade_table': [], 'stripe_width': 0, 'expected_num_objects': 0, 'fast_read': False, 'options': {'pg_num_max': 32, 'pg_num_min': 1}, 'application_metadata': {'mgr': {}}}] 2024-05-25T05:12:28.540 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd pool get .mgr pg_num 2024-05-25T05:12:28.751 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:12:29.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:29 smithi088 ceph-mon[24736]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-25T05:12:29.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:29 smithi088 ceph-mon[29649]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-25T05:12:29.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:29 smithi136 ceph-mon[25618]: pgmap v179: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 109 KiB/s, 0 objects/s recovering 2024-05-25T05:12:30.476 INFO:teuthology.orchestra.run.smithi088.stdout:pg_num: 1 2024-05-25T05:12:30.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:30 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2925307451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-25T05:12:30.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:30 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2925307451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-25T05:12:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:30 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2925307451' entity='client.admin' cmd=[{"prefix": "osd pool get", "pool": ".mgr", "var": "pg_num"}]: dispatch 2024-05-25T05:12:31.050 INFO:tasks.cephadm:Adding prometheus.a on smithi136 2024-05-25T05:12:31.050 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch apply prometheus '1;smithi136=a' 2024-05-25T05:12:31.128 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:12:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:12:31.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:31 smithi136 ceph-mon[25618]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-25T05:12:31.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:31 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:31.626 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:31 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:31.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:31 smithi088 ceph-mon[24736]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-25T05:12:31.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:31 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:31.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:31 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:31.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:31 smithi088 ceph-mon[29649]: pgmap v180: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 86 KiB/s, 0 objects/s recovering 2024-05-25T05:12:31.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:31 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:31.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:31 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:32.918 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled prometheus update... 2024-05-25T05:12:33.586 DEBUG:teuthology.orchestra.run.smithi136:prometheus.a> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service 2024-05-25T05:12:33.588 INFO:tasks.cephadm:Adding node-exporter.a on smithi088 2024-05-25T05:12:33.588 INFO:tasks.cephadm:Adding node-exporter.b on smithi136 2024-05-25T05:12:33.588 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch apply node-exporter '2;smithi088=a;smithi136=b' 2024-05-25T05:12:33.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:33 smithi136 ceph-mon[25618]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-25T05:12:33.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:33.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:33.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:33.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:33.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:33.611 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:33 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-25T05:12:33.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[24736]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-25T05:12:33.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:33.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:33.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:33.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:33.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[29649]: pgmap v181: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail; 67 KiB/s, 0 objects/s recovering 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' 2024-05-25T05:12:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:33 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-25T05:12:34.162 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ignoring --setuser ceph since I am not root 2024-05-25T05:12:34.162 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ignoring --setgroup ceph since I am not root 2024-05-25T05:12:34.162 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-mgr[27154]: -- 172.21.15.136:0/2298040206 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x55a94e860340 con 0x55a94e838c00 2024-05-25T05:12:34.162 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:34.162+0000 7ffaaac4c000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:12:34.276 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setuser ceph since I am not root 2024-05-25T05:12:34.276 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setgroup ceph since I am not root 2024-05-25T05:12:34.276 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mgr[24968]: -- 172.21.15.88:0/1203332519 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x562725c12340 con 0x562725beac00 2024-05-25T05:12:34.276 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:34.147+0000 7f068a6eb000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:12:34.276 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:34.276+0000 7f068a6eb000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:12:34.448 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:34.297+0000 7ffaaac4c000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:12:34.449 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:34.403+0000 7ffaaac4c000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:12:34.528 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:34.375+0000 7f068a6eb000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:12:34.727 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:34 smithi136 ceph-mon[25618]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:34.727 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:34 smithi136 ceph-mon[25618]: Saving service prometheus spec with placement smithi136=a;count:1 2024-05-25T05:12:34.727 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:34 smithi136 ceph-mon[25618]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-25T05:12:34.727 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:34 smithi136 ceph-mon[25618]: mgrmap e16: y(active, since 4m), standbys: x 2024-05-25T05:12:34.727 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:34.726+0000 7ffaaac4c000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:12:34.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:34.681+0000 7f068a6eb000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:12:34.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:34.764+0000 7f068a6eb000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[24736]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[24736]: Saving service prometheus spec with placement smithi136=a;count:1 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[24736]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[24736]: mgrmap e16: y(active, since 4m), standbys: x 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[29649]: from='client.24323 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "prometheus", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[29649]: Saving service prometheus spec with placement smithi136=a;count:1 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[29649]: from='mgr.14152 172.21.15.88:0/735542182' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-25T05:12:34.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:34 smithi088 ceph-mon[29649]: mgrmap e16: y(active, since 4m), standbys: x 2024-05-25T05:12:35.026 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:34.811+0000 7ffaaac4c000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:12:36.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:35.882+0000 7f068a6eb000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:12:36.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:36.046+0000 7f068a6eb000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:12:36.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:36.129+0000 7f068a6eb000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:12:36.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:35.963+0000 7ffaaac4c000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:12:36.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:36.127+0000 7ffaaac4c000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:12:36.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:36.209+0000 7ffaaac4c000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:12:36.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:36.443+0000 7f068a6eb000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:12:36.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:36.535+0000 7f068a6eb000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:12:36.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:36.629+0000 7f068a6eb000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:12:36.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:36.522+0000 7ffaaac4c000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:12:36.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:36.614+0000 7ffaaac4c000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:12:36.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:36.705+0000 7ffaaac4c000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:12:37.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:36.877+0000 7f068a6eb000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:12:37.376 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:36.943+0000 7ffaaac4c000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:12:37.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:37.376+0000 7ffaaac4c000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:12:37.801 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:37 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:37.315+0000 7f068a6eb000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:12:38.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:37 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:37.801+0000 7f068a6eb000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:12:38.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:37 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:37.894+0000 7f068a6eb000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:12:38.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:37.857+0000 7ffaaac4c000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:12:38.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:37.950+0000 7ffaaac4c000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:12:38.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:38.189+0000 7f068a6eb000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:12:38.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:38.280+0000 7f068a6eb000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:12:38.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:38.243+0000 7ffaaac4c000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:12:38.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:38.332+0000 7ffaaac4c000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:12:39.026 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:38.684+0000 7f068a6eb000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:12:39.026 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:38.817+0000 7f068a6eb000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:12:39.026 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:38.911+0000 7f068a6eb000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:12:39.026 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:39.026+0000 7f068a6eb000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:12:39.071 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:38.737+0000 7ffaaac4c000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:12:39.071 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:38.866+0000 7ffaaac4c000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:12:39.071 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:38.957+0000 7ffaaac4c000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:12:39.071 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:39.071+0000 7ffaaac4c000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:12:39.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:39.115+0000 7f068a6eb000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:12:39.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:39.159+0000 7ffaaac4c000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:12:40.028 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:39.664+0000 7f068a6eb000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:12:40.060 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:39.697+0000 7ffaaac4c000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:40.028+0000 7f068a6eb000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:12:40] ENGINE Bus STARTING 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: Active manager daemon y restarted 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: Activating manager daemon y 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: osdmap e60: 8 total, 8 up, 8 in 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: Standby manager daemon x restarted 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:12:40.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: Active manager daemon y restarted 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: Activating manager daemon y 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: osdmap e60: 8 total, 8 up, 8 in 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: Standby manager daemon x restarted 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:12:40.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:12:40.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:12:40.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:12:40.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:40.060+0000 7ffaaac4c000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: [25/May/2024:05:12:40] ENGINE Bus STARTING 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: CherryPy Checker: 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: The Application mounted at '' has an empty config. 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: [25/May/2024:05:12:40] ENGINE Serving on http://:::9283 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:12:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: [25/May/2024:05:12:40] ENGINE Bus STARTED 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: Active manager daemon y restarted 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: Activating manager daemon y 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: osdmap e60: 8 total, 8 up, 8 in 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: Standby manager daemon x restarted 2024-05-25T05:12:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:12:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:12:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:12:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:12:40.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/10639849' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:12:40.544 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: CherryPy Checker: 2024-05-25T05:12:40.544 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: The Application mounted at '' has an empty config. 2024-05-25T05:12:40.544 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:12:40.544 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:12:40] ENGINE Serving on http://:::9283 2024-05-25T05:12:40.544 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:12:40] ENGINE Bus STARTED 2024-05-25T05:12:40.544 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:12:40] ENGINE Bus STARTING 2024-05-25T05:12:40.544 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:12:40] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:12:40.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:12:40] ENGINE Bus STARTED 2024-05-25T05:12:41.115 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled node-exporter update... 2024-05-25T05:12:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: mgrmap e17: y(active, starting, since 0.0558931s), standbys: x 2024-05-25T05:12:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:12:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:12:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:12:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:12:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:12:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: Manager daemon y is now available 2024-05-25T05:12:41.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]': finished 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]': finished 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:12:41.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: [25/May/2024:05:12:40] ENGINE Bus STARTING 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: [25/May/2024:05:12:40] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: [25/May/2024:05:12:40] ENGINE Bus STARTED 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-25T05:12:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: mgrmap e17: y(active, starting, since 0.0558931s), standbys: x 2024-05-25T05:12:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:12:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:12:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:12:41.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: Manager daemon y is now available 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]': finished 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:12:41.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: mgrmap e17: y(active, starting, since 0.0558931s), standbys: x 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:12:41.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: Manager daemon y is now available 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]': finished 2024-05-25T05:12:41.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]': finished 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: [25/May/2024:05:12:40] ENGINE Bus STARTING 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: [25/May/2024:05:12:40] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: [25/May/2024:05:12:40] ENGINE Bus STARTED 2024-05-25T05:12:41.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]': finished 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: [25/May/2024:05:12:40] ENGINE Bus STARTING 2024-05-25T05:12:41.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: [25/May/2024:05:12:40] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: [25/May/2024:05:12:40] ENGINE Bus STARTED 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:41.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr module enable", "module": "prometheus"}]: dispatch 2024-05-25T05:12:41.743 DEBUG:teuthology.orchestra.run.smithi088:node-exporter.a> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service 2024-05-25T05:12:41.746 DEBUG:teuthology.orchestra.run.smithi136:node-exporter.b> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service 2024-05-25T05:12:41.749 INFO:tasks.cephadm:Adding alertmanager.a on smithi088 2024-05-25T05:12:41.749 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch apply alertmanager '1;smithi088=a' 2024-05-25T05:12:42.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:42 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-25T05:12:42.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:42 smithi136 ceph-mon[25618]: mgrmap e18: y(active, since 1.07093s), standbys: x 2024-05-25T05:12:42.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:42 smithi136 ceph-mon[25618]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi088=a;smithi136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:42.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:42 smithi136 ceph-mon[25618]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:42.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:42 smithi136 ceph-mon[25618]: Saving service node-exporter spec with placement smithi088=a;smithi136=b;count:2 2024-05-25T05:12:42.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:42 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:42.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:42 smithi136 ceph-mon[25618]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:12:42.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[24736]: mgrmap e18: y(active, since 1.07093s), standbys: x 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[24736]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi088=a;smithi136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[24736]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[24736]: Saving service node-exporter spec with placement smithi088=a;smithi136=b;count:2 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[24736]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "mgr module enable", "module": "prometheus"}]': finished 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[29649]: mgrmap e18: y(active, since 1.07093s), standbys: x 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[29649]: from='client.24341 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "node-exporter", "placement": "2;smithi088=a;smithi136=b", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[29649]: pgmap v3: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[29649]: Saving service node-exporter spec with placement smithi088=a;smithi136=b;count:2 2024-05-25T05:12:42.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:42 smithi088 ceph-mon[29649]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:12:43.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:12:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:12:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[24736]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[24736]: mgrmap e19: y(active, since 2s), standbys: x 2024-05-25T05:12:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[24736]: Detected new or changed devices on smithi136 2024-05-25T05:12:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[29649]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[29649]: mgrmap e19: y(active, since 2s), standbys: x 2024-05-25T05:12:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[29649]: Detected new or changed devices on smithi136 2024-05-25T05:12:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:43.367 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:43 smithi136 ceph-mon[25618]: pgmap v4: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:43.367 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:43 smithi136 ceph-mon[25618]: mgrmap e19: y(active, since 2s), standbys: x 2024-05-25T05:12:43.367 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:43.367 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:43 smithi136 ceph-mon[25618]: Detected new or changed devices on smithi136 2024-05-25T05:12:43.367 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:44.186 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled alertmanager update... 2024-05-25T05:12:45.319 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:45 smithi136 ceph-mon[25618]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:45.319 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:45 smithi136 ceph-mon[25618]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi088=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:45.319 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:45 smithi136 ceph-mon[25618]: Saving service alertmanager spec with placement smithi088=a;count:1 2024-05-25T05:12:45.319 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:45 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:45.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[24736]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:45.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[24736]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi088=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:45.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[24736]: Saving service alertmanager spec with placement smithi088=a;count:1 2024-05-25T05:12:45.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:45.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[29649]: pgmap v5: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:45.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[29649]: from='client.24368 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "alertmanager", "placement": "1;smithi088=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:45.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[29649]: Saving service alertmanager spec with placement smithi088=a;count:1 2024-05-25T05:12:45.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:45 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:46.075 DEBUG:teuthology.orchestra.run.smithi088:alertmanager.a> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service 2024-05-25T05:12:46.078 INFO:tasks.cephadm:Adding grafana.a on smithi136 2024-05-25T05:12:46.078 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph orch apply grafana '1;smithi136=a' 2024-05-25T05:12:47.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:47 smithi088 ceph-mon[29649]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:47.458 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:47 smithi088 ceph-mon[24736]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:47.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:47 smithi136 ceph-mon[25618]: pgmap v6: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:49 smithi088 ceph-mon[29649]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:49.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:49 smithi088 ceph-mon[24736]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:49.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:49 smithi136 ceph-mon[25618]: pgmap v7: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:50.769 INFO:teuthology.orchestra.run.smithi136.stdout:Scheduled grafana update... 2024-05-25T05:12:51.272 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:12:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:12:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:12:51.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[24736]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:51.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[24736]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:51.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[24736]: Saving service grafana spec with placement smithi136=a;count:1 2024-05-25T05:12:51.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:51.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:51.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:51.869 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[29649]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:51.869 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[29649]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:51.869 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[29649]: Saving service grafana spec with placement smithi136=a;count:1 2024-05-25T05:12:51.869 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:51.869 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:51.869 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:52.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:51 smithi136 ceph-mon[25618]: pgmap v8: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:52.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:51 smithi136 ceph-mon[25618]: from='client.24374 -' entity='client.admin' cmd=[{"prefix": "orch apply", "service_type": "grafana", "placement": "1;smithi136=a", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:12:52.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:51 smithi136 ceph-mon[25618]: Saving service grafana spec with placement smithi136=a;count:1 2024-05-25T05:12:52.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:52.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:52.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:53.869 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:53 smithi136 ceph-mon[25618]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:53 smithi088 ceph-mon[29649]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:53 smithi088 ceph-mon[24736]: pgmap v9: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:54.125 DEBUG:teuthology.orchestra.run.smithi136:grafana.a> sudo journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service 2024-05-25T05:12:54.130 INFO:tasks.cephadm:Setting up client nodes... 2024-05-25T05:12:54.130 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.0 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-25T05:12:54.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 podman[41531]: 2024-05-25 05:12:54.341026481 +0000 UTC m=+0.145032597 container create 3ff1574868ee3bcb24682c6e215762dd7367c3457b8813b7c5963321c758dc42 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:12:54.722 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 podman[41531]: 2024-05-25 05:12:54.568414908 +0000 UTC m=+0.372420977 container init 3ff1574868ee3bcb24682c6e215762dd7367c3457b8813b7c5963321c758dc42 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:12:54.722 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 podman[41531]: 2024-05-25 05:12:54.57113837 +0000 UTC m=+0.375144442 container start 3ff1574868ee3bcb24682c6e215762dd7367c3457b8813b7c5963321c758dc42 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:12:54.722 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.594Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-25T05:12:54.722 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.594Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.594Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.594Z caller=main.go:518 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.594Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.594Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.595Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.596Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.597Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.599Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.599Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.768µs 2024-05-25T05:12:54.723 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.599Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.599Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=0 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.599Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=20.012µs wal_replay_duration=153.667µs total_replay_duration=187.355µs 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.601Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.601Z caller=main.go:947 level=info msg="TSDB started" 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.601Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.615Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=14.84828ms db_storage=592ns remote_storage=1.301µs web_handler=370ns query_engine=558ns scrape=381.671µs scrape_sd=16.309µs notify=1.292µs notify_sd=1.329µs rules=14.272829ms 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:12:54.616Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 bash[41531]: 3ff1574868ee3bcb24682c6e215762dd7367c3457b8813b7c5963321c758dc42 2024-05-25T05:12:54.724 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:12:54 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:12:56.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:56.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.136:9095"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.136:9095"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.136:9095"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.136:9095"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: pgmap v10: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.136:9095"}]: dispatch 2024-05-25T05:12:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://172.21.15.136:9095"}]: dispatch 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:12:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:12:56.168 INFO:teuthology.orchestra.run.smithi088.stdout:[client.0] 2024-05-25T05:12:56.168 INFO:teuthology.orchestra.run.smithi088.stdout: key = AQBYc1Fm2z7VCRAAGuXBi/NY9QekcMnKY4MTGQ== 2024-05-25T05:12:56.754 DEBUG:teuthology.orchestra.run.smithi088:> set -ex 2024-05-25T05:12:56.754 DEBUG:teuthology.orchestra.run.smithi088:> sudo dd of=/etc/ceph/ceph.client.0.keyring 2024-05-25T05:12:56.754 DEBUG:teuthology.orchestra.run.smithi088:> sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-05-25T05:12:56.794 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph auth get-or-create client.1 mon 'allow *' osd 'allow *' mds 'allow *' mgr 'allow *' 2024-05-25T05:12:57.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:56 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1458734791' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:12:57.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:56 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:12:57.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:56 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-25T05:12:57.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:56 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1458734791' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:12:57.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:56 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:12:57.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:56 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-25T05:12:57.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:56 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1458734791' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:12:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:56 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:12:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:56 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.0", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-25T05:12:58.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:57 smithi088 ceph-mon[29649]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:57 smithi088 ceph-mon[24736]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:12:58.090 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:57 smithi136 ceph-mon[25618]: pgmap v11: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:00.052 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:12:59 smithi136 ceph-mon[25618]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:00.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:12:59 smithi088 ceph-mon[24736]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:00.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:12:59 smithi088 ceph-mon[29649]: pgmap v12: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:01.414 INFO:teuthology.orchestra.run.smithi136.stdout:[client.1] 2024-05-25T05:13:01.414 INFO:teuthology.orchestra.run.smithi136.stdout: key = AQBdc1Fmt2tRGBAATUwugxYdVYJnGFaZs+p97w== 2024-05-25T05:13:02.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:13:01] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[24736]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[24736]: from='client.? 172.21.15.136:0/4088369718' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:13:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:13:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-25T05:13:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[29649]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[29649]: from='client.? 172.21.15.136:0/4088369718' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:13:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:13:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:01 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-25T05:13:02.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:01 smithi136 ceph-mon[25618]: pgmap v13: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:02.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:01 smithi136 ceph-mon[25618]: from='client.? 172.21.15.136:0/4088369718' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:13:02.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:01 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]: dispatch 2024-05-25T05:13:02.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:01 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "auth get-or-create", "entity": "client.1", "caps": ["mon", "allow *", "osd", "allow *", "mds", "allow *", "mgr", "allow *"]}]': finished 2024-05-25T05:13:02.421 DEBUG:teuthology.orchestra.run.smithi136:> set -ex 2024-05-25T05:13:02.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo dd of=/etc/ceph/ceph.client.1.keyring 2024-05-25T05:13:02.421 DEBUG:teuthology.orchestra.run.smithi136:> sudo chmod 0644 /etc/ceph/ceph.client.1.keyring 2024-05-25T05:13:02.463 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-05-25T05:13:02.463 INFO:tasks.cephadm.ceph_manager.ceph:waiting for mgr available 2024-05-25T05:13:02.463 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph mgr dump --format=json 2024-05-25T05:13:02.686 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:03.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:02 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:02 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:03.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:02 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:04.114 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:13:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:04.115 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:03 smithi088 ceph-mon[24736]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:04.115 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:03 smithi088 ceph-mon[29649]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:03 smithi136 ceph-mon[25618]: pgmap v14: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:04.620 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:13:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2957919782' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:13:05.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:04 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2957919782' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:13:05.353 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":19,"active_gid":14442,"active_name":"y","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6800","nonce":3868046149},{"type":"v1","addr":"172.21.15.88:6801","nonce":3868046149}]},"active_addr":"172.21.15.88:6801/3868046149","active_change":"2024-05-25T05:12:40.030422+0000","active_mgr_features":4540138303579357183,"available":true,"standbys":[{"gid":24329,"name":"x","mgr_features":4540138303579357183,"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}]}],"modules":["cephadm","dashboard","iostat","nfs","prometheus","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2400","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"7","min":"0","max":"7","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 or 7 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","upmap"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.23.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/ceph-grafana:8.3.5","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"docker.io/library/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"docker.io/arcts/keepalived","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.3.1","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.33.4","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"k8sevents","can_run":true,"error_string":"","module_options":{"ceph_event_retention_days":{"name":"ceph_event_retention_days","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"Days to hold ceph event information within local cache","long_desc":"","tags":[],"see_also":[]},"config_check_secs":{"name":"config_check_secs","type":"int","level":"advanced","flags":0,"default_value":"10","min":"10","max":"","enum_allowed":[],"desc":"interval (secs) to check for cluster configuration changes","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"noautoscale":{"name":"noautoscale","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"global autoscale flag","long_desc":"Option to turn on/off the autoscaler for all pools","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"drive_group_interval":{"name":"drive_group_interval","type":"float","level":"advanced","flags":0,"default_value":"300.0","min":"","max":"","enum_allowed":[],"desc":"interval in seconds between re-application of applied drive_groups","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{"dashboard":"https://172.21.15.88:8443/","prometheus":"http://172.21.15.88:9283/"},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"last_failure_osd_epoch":60,"active_clients":[{"addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":2675402558}]},{"addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":659201408}]},{"addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":1306220663}]},{"addrvec":[{"type":"v2","addr":"172.21.15.88:0","nonce":3626990987}]}]}} 2024-05-25T05:13:05.357 INFO:tasks.cephadm.ceph_manager.ceph:mgr available! 2024-05-25T05:13:05.357 INFO:tasks.cephadm.ceph_manager.ceph:waiting for all up 2024-05-25T05:13:05.357 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-25T05:13:05.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:13:05.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:13:05.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:13:05.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:05.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:13:05.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:04 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2957919782' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:13:05.598 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:05.721 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:05 smithi088 bash[45542]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-05-25T05:13:06.004 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:05 smithi088 bash[45542]: Getting image source signatures 2024-05-25T05:13:06.004 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:05 smithi088 bash[45542]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-05-25T05:13:06.004 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:05 smithi088 bash[45542]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-05-25T05:13:06.004 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:05 smithi088 bash[45542]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-05-25T05:13:06.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:06 smithi088 ceph-mon[29649]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:06.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:06 smithi088 ceph-mon[24736]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:06 smithi136 ceph-mon[25618]: pgmap v15: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:07.930 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:07 smithi088 bash[45542]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-05-25T05:13:08.091 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:13:08.091 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":60,"fsid":"9a885618-1a54-11ef-bc9b-c7b262605968","created":"2024-05-25T05:07:29.070009+0000","modified":"2024-05-25T05:12:40.030101+0000","last_up_change":"2024-05-25T05:12:22.176493+0000","last_in_change":"2024-05-25T05:12:04.129376+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-25T05:10:31.022608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"2870ce62-38d4-45ad-8d11-fad3a2bef386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6803","nonce":1207909643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6805","nonce":1207909643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6809","nonce":1207909643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6807","nonce":1207909643}]},"public_addr":"172.21.15.88:6803/1207909643","cluster_addr":"172.21.15.88:6805/1207909643","heartbeat_back_addr":"172.21.15.88:6809/1207909643","heartbeat_front_addr":"172.21.15.88:6807/1207909643","state":["exists","up"]},{"osd":1,"uuid":"abf35f19-27d1-499d-a7c5-2960d202841a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6811","nonce":1328023184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6813","nonce":1328023184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6817","nonce":1328023184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6815","nonce":1328023184}]},"public_addr":"172.21.15.88:6811/1328023184","cluster_addr":"172.21.15.88:6813/1328023184","heartbeat_back_addr":"172.21.15.88:6817/1328023184","heartbeat_front_addr":"172.21.15.88:6815/1328023184","state":["exists","up"]},{"osd":2,"uuid":"dbc42aa3-f39d-4122-b4df-4510e612e1b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6819","nonce":4166017164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6821","nonce":4166017164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6825","nonce":4166017164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6823","nonce":4166017164}]},"public_addr":"172.21.15.88:6819/4166017164","cluster_addr":"172.21.15.88:6821/4166017164","heartbeat_back_addr":"172.21.15.88:6825/4166017164","heartbeat_front_addr":"172.21.15.88:6823/4166017164","state":["exists","up"]},{"osd":3,"uuid":"aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6827","nonce":2889452858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6829","nonce":2889452858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6833","nonce":2889452858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6831","nonce":2889452858}]},"public_addr":"172.21.15.88:6827/2889452858","cluster_addr":"172.21.15.88:6829/2889452858","heartbeat_back_addr":"172.21.15.88:6833/2889452858","heartbeat_front_addr":"172.21.15.88:6831/2889452858","state":["exists","up"]},{"osd":4,"uuid":"b4cde1e9-7947-45f9-b572-7e2a0df3e470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6801","nonce":719773022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6803","nonce":719773022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6807","nonce":719773022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6805","nonce":719773022}]},"public_addr":"172.21.15.136:6801/719773022","cluster_addr":"172.21.15.136:6803/719773022","heartbeat_back_addr":"172.21.15.136:6807/719773022","heartbeat_front_addr":"172.21.15.136:6805/719773022","state":["exists","up"]},{"osd":5,"uuid":"329f387d-fa0d-4691-b553-a10e65cba34f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6809","nonce":3520847580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6811","nonce":3520847580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6815","nonce":3520847580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6813","nonce":3520847580}]},"public_addr":"172.21.15.136:6809/3520847580","cluster_addr":"172.21.15.136:6811/3520847580","heartbeat_back_addr":"172.21.15.136:6815/3520847580","heartbeat_front_addr":"172.21.15.136:6813/3520847580","state":["exists","up"]},{"osd":6,"uuid":"c3338af4-af10-4b5d-9107-2cd6f0e30ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6817","nonce":4246335252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6819","nonce":4246335252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6823","nonce":4246335252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6821","nonce":4246335252}]},"public_addr":"172.21.15.136:6817/4246335252","cluster_addr":"172.21.15.136:6819/4246335252","heartbeat_back_addr":"172.21.15.136:6823/4246335252","heartbeat_front_addr":"172.21.15.136:6821/4246335252","state":["exists","up"]},{"osd":7,"uuid":"612900ea-482c-4db2-bd28-903c800ee2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6825","nonce":366893250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6827","nonce":366893250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6831","nonce":366893250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6829","nonce":366893250}]},"public_addr":"172.21.15.136:6825/366893250","cluster_addr":"172.21.15.136:6827/366893250","heartbeat_back_addr":"172.21.15.136:6831/366893250","heartbeat_front_addr":"172.21.15.136:6829/366893250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:09:40.914150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:03.298943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:27.052417+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:51.219651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:14.130257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:35.798753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:57.867955+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:12:20.478913+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/3254992861":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/2846313922":"2024-05-26T05:12:40.030068+0000","172.21.15.88:6801/2448700089":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/685032161":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6801/3566449769":"2024-05-26T05:08:22.665414+0000","172.21.15.88:0/3728950008":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/2974971448":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6800/2448700089":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/3280524365":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/1340989008":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/3522756593":"2024-05-26T05:12:40.030068+0000","172.21.15.88:6800/3566449769":"2024-05-26T05:08:22.665414+0000","172.21.15.88:0/2057106370":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/1577678860":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6800/912908121":"2024-05-26T05:08:00.553776+0000","172.21.15.88:6801/912908121":"2024-05-26T05:08:00.553776+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-25T05:13:08.188 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:08 smithi088 ceph-mon[24736]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:08.189 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:08 smithi088 ceph-mon[29649]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:08.189 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:08 smithi088 bash[45542]: Writing manifest to image destination 2024-05-25T05:13:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:08 smithi136 ceph-mon[25618]: pgmap v16: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:08.806 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:08 smithi088 podman[45542]: 2024-05-25 05:13:08.54047433 +0000 UTC m=+3.111243385 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-25T05:13:08.922 INFO:tasks.cephadm.ceph_manager.ceph:all up! 2024-05-25T05:13:08.923 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd dump --format=json 2024-05-25T05:13:09.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1510021274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:13:09.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:09 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1510021274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:13:09.307 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 podman[45542]: 2024-05-25 05:13:09.039800146 +0000 UTC m=+3.610569241 container create 8b301195053369ef9fabe394565a888e0f0d1b65277432df975bd43e12d09098 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:13:09.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:09 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1510021274' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 podman[45542]: 2024-05-25 05:13:09.74525579 +0000 UTC m=+4.316024838 container init 8b301195053369ef9fabe394565a888e0f0d1b65277432df975bd43e12d09098 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 podman[45542]: 2024-05-25 05:13:09.74843637 +0000 UTC m=+4.319205428 container start 8b301195053369ef9fabe394565a888e0f0d1b65277432df975bd43e12d09098 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.751Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.751Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.751Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.751Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=arp 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-25T05:13:09.754 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=edac 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-25T05:13:09.755 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-25T05:13:09.756 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-25T05:13:09.899 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:10.017 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=os 2024-05-25T05:13:10.017 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-25T05:13:10.017 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=stat 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=time 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=uname 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-25T05:13:10.018 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.752Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-25T05:13:10.019 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.753Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-25T05:13:10.019 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[45874]: ts=2024-05-25T05:13:09.753Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-25T05:13:10.019 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 bash[45542]: 8b301195053369ef9fabe394565a888e0f0d1b65277432df975bd43e12d09098 2024-05-25T05:13:10.019 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:13:09 smithi088 systemd[1]: Started Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:13:10.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:10 smithi136 ceph-mon[25618]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:10.218 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:10.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:10 smithi088 ceph-mon[29649]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:10.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:10.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:10 smithi088 ceph-mon[24736]: pgmap v17: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:10.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:10.779 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:10 smithi136 systemd[1]: Starting Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:13:11.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:11 smithi088 ceph-mon[29649]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:13:11.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:11 smithi136 ceph-mon[25618]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:13:11.134 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:10 smithi136 bash[42486]: Trying to pull quay.io/prometheus/node-exporter:v1.3.1... 2024-05-25T05:13:11.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:11 smithi088 ceph-mon[24736]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:13:11.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:11 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:13:11] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:11.634 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:11 smithi136 bash[42486]: Getting image source signatures 2024-05-25T05:13:11.634 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:11 smithi136 bash[42486]: Copying blob sha256:b5db1e299295edf3005515ab7879c1df64a33c185d3a7a23aa4dcaa17d26f7b3 2024-05-25T05:13:11.634 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:11 smithi136 bash[42486]: Copying blob sha256:aa2a8d90b84cb2a9c422e7005cd166a008ccf22ef5d7d4f07128478585ce35ea 2024-05-25T05:13:11.634 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:11 smithi136 bash[42486]: Copying blob sha256:b45d31ee2d7f9f452678a85b0c837c29e12089f31ee8dbac6c8c24dfa4054a30 2024-05-25T05:13:11.849 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:13:11.849 INFO:teuthology.orchestra.run.smithi088.stdout:{"epoch":60,"fsid":"9a885618-1a54-11ef-bc9b-c7b262605968","created":"2024-05-25T05:07:29.070009+0000","modified":"2024-05-25T05:12:40.030101+0000","last_up_change":"2024-05-25T05:12:22.176493+0000","last_in_change":"2024-05-25T05:12:04.129376+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":18,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":8,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"quincy","pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-05-25T05:10:31.022608+0000","flags":1,"flags_names":"hashpspool","type":1,"size":3,"min_size":2,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"22","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}}}],"osds":[{"osd":0,"uuid":"2870ce62-38d4-45ad-8d11-fad3a2bef386","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":8,"up_thru":57,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6802","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6803","nonce":1207909643}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6804","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6805","nonce":1207909643}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6808","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6809","nonce":1207909643}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6806","nonce":1207909643},{"type":"v1","addr":"172.21.15.88:6807","nonce":1207909643}]},"public_addr":"172.21.15.88:6803/1207909643","cluster_addr":"172.21.15.88:6805/1207909643","heartbeat_back_addr":"172.21.15.88:6809/1207909643","heartbeat_front_addr":"172.21.15.88:6807/1207909643","state":["exists","up"]},{"osd":1,"uuid":"abf35f19-27d1-499d-a7c5-2960d202841a","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":13,"up_thru":34,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6810","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6811","nonce":1328023184}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6812","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6813","nonce":1328023184}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6816","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6817","nonce":1328023184}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6814","nonce":1328023184},{"type":"v1","addr":"172.21.15.88:6815","nonce":1328023184}]},"public_addr":"172.21.15.88:6811/1328023184","cluster_addr":"172.21.15.88:6813/1328023184","heartbeat_back_addr":"172.21.15.88:6817/1328023184","heartbeat_front_addr":"172.21.15.88:6815/1328023184","state":["exists","up"]},{"osd":2,"uuid":"dbc42aa3-f39d-4122-b4df-4510e612e1b5","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":18,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6818","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6819","nonce":4166017164}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6820","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6821","nonce":4166017164}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6824","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6825","nonce":4166017164}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6822","nonce":4166017164},{"type":"v1","addr":"172.21.15.88:6823","nonce":4166017164}]},"public_addr":"172.21.15.88:6819/4166017164","cluster_addr":"172.21.15.88:6821/4166017164","heartbeat_back_addr":"172.21.15.88:6825/4166017164","heartbeat_front_addr":"172.21.15.88:6823/4166017164","state":["exists","up"]},{"osd":3,"uuid":"aaadc5b2-6cfe-4fdd-bc8e-ea00f037f673","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":26,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6826","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6827","nonce":2889452858}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6828","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6829","nonce":2889452858}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6832","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6833","nonce":2889452858}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.88:6830","nonce":2889452858},{"type":"v1","addr":"172.21.15.88:6831","nonce":2889452858}]},"public_addr":"172.21.15.88:6827/2889452858","cluster_addr":"172.21.15.88:6829/2889452858","heartbeat_back_addr":"172.21.15.88:6833/2889452858","heartbeat_front_addr":"172.21.15.88:6831/2889452858","state":["exists","up"]},{"osd":4,"uuid":"b4cde1e9-7947-45f9-b572-7e2a0df3e470","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":31,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6800","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6801","nonce":719773022}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6802","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6803","nonce":719773022}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6806","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6807","nonce":719773022}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6804","nonce":719773022},{"type":"v1","addr":"172.21.15.136:6805","nonce":719773022}]},"public_addr":"172.21.15.136:6801/719773022","cluster_addr":"172.21.15.136:6803/719773022","heartbeat_back_addr":"172.21.15.136:6807/719773022","heartbeat_front_addr":"172.21.15.136:6805/719773022","state":["exists","up"]},{"osd":5,"uuid":"329f387d-fa0d-4691-b553-a10e65cba34f","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":39,"up_thru":42,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6808","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6809","nonce":3520847580}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6810","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6811","nonce":3520847580}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6814","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6815","nonce":3520847580}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6812","nonce":3520847580},{"type":"v1","addr":"172.21.15.136:6813","nonce":3520847580}]},"public_addr":"172.21.15.136:6809/3520847580","cluster_addr":"172.21.15.136:6811/3520847580","heartbeat_back_addr":"172.21.15.136:6815/3520847580","heartbeat_front_addr":"172.21.15.136:6813/3520847580","state":["exists","up"]},{"osd":6,"uuid":"c3338af4-af10-4b5d-9107-2cd6f0e30ea2","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":47,"up_thru":50,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6816","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6817","nonce":4246335252}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6818","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6819","nonce":4246335252}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6822","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6823","nonce":4246335252}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6820","nonce":4246335252},{"type":"v1","addr":"172.21.15.136:6821","nonce":4246335252}]},"public_addr":"172.21.15.136:6817/4246335252","cluster_addr":"172.21.15.136:6819/4246335252","heartbeat_back_addr":"172.21.15.136:6823/4246335252","heartbeat_front_addr":"172.21.15.136:6821/4246335252","state":["exists","up"]},{"osd":7,"uuid":"612900ea-482c-4db2-bd28-903c800ee2d8","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":55,"up_thru":58,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6824","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6825","nonce":366893250}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6826","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6827","nonce":366893250}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6830","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6831","nonce":366893250}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.136:6828","nonce":366893250},{"type":"v1","addr":"172.21.15.136:6829","nonce":366893250}]},"public_addr":"172.21.15.136:6825/366893250","cluster_addr":"172.21.15.136:6827/366893250","heartbeat_back_addr":"172.21.15.136:6831/366893250","heartbeat_front_addr":"172.21.15.136:6829/366893250","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:09:40.914150+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:03.298943+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:27.052417+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:10:51.219651+0000","dead_epoch":0},{"osd":4,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:14.130257+0000","dead_epoch":0},{"osd":5,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:35.798753+0000","dead_epoch":0},{"osd":6,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:11:57.867955+0000","dead_epoch":0},{"osd":7,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540138303579357183,"old_weight":0,"last_purged_snaps_scrub":"2024-05-25T05:12:20.478913+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_temp":[],"primary_temp":[],"blocklist":{"172.21.15.88:0/3254992861":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/2846313922":"2024-05-26T05:12:40.030068+0000","172.21.15.88:6801/2448700089":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/685032161":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6801/3566449769":"2024-05-26T05:08:22.665414+0000","172.21.15.88:0/3728950008":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/2974971448":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6800/2448700089":"2024-05-26T05:12:40.030068+0000","172.21.15.88:0/3280524365":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/1340989008":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/3522756593":"2024-05-26T05:12:40.030068+0000","172.21.15.88:6800/3566449769":"2024-05-26T05:08:22.665414+0000","172.21.15.88:0/2057106370":"2024-05-26T05:08:00.553776+0000","172.21.15.88:0/1577678860":"2024-05-26T05:08:22.665414+0000","172.21.15.88:6800/912908121":"2024-05-26T05:08:00.553776+0000","172.21.15.88:6801/912908121":"2024-05-26T05:08:00.553776+0000"},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-05-25T05:13:12.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[24736]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2418887577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:13:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[29649]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:12 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2418887577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:13:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:12 smithi136 ceph-mon[25618]: pgmap v18: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:12 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:12 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:12 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2418887577' entity='client.admin' cmd=[{"prefix": "osd dump", "format": "json"}]: dispatch 2024-05-25T05:13:12.884 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:12 smithi136 bash[42486]: Copying config sha256:1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 2024-05-25T05:13:12.884 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:12 smithi136 bash[42486]: Writing manifest to image destination 2024-05-25T05:13:13.161 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.0 flush_pg_stats 2024-05-25T05:13:13.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.1 flush_pg_stats 2024-05-25T05:13:13.162 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.2 flush_pg_stats 2024-05-25T05:13:13.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.3 flush_pg_stats 2024-05-25T05:13:13.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.4 flush_pg_stats 2024-05-25T05:13:13.163 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.5 flush_pg_stats 2024-05-25T05:13:13.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.6 flush_pg_stats 2024-05-25T05:13:13.164 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph tell osd.7 flush_pg_stats 2024-05-25T05:13:13.311 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 podman[42486]: 2024-05-25 05:13:12.960886576 +0000 UTC m=+2.273984487 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-25T05:13:13.311 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 podman[42486]: 2024-05-25 05:13:13.067771949 +0000 UTC m=+2.380869861 container create 25581f6d105b1b97f0495fb1868a9237c1a35cdc4ba16434e2c9b85d1f464ac9 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 podman[42486]: 2024-05-25 05:13:13.311884464 +0000 UTC m=+2.624982355 container init 25581f6d105b1b97f0495fb1868a9237c1a35cdc4ba16434e2c9b85d1f464ac9 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 podman[42486]: 2024-05-25 05:13:13.31514267 +0000 UTC m=+2.628240576 container start 25581f6d105b1b97f0495fb1868a9237c1a35cdc4ba16434e2c9b85d1f464ac9 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.319Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.319Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=arp 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-25T05:13:13.635 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=edac 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-25T05:13:13.636 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-25T05:13:13.637 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=os 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=stat 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.320Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=node_exporter.go:115 level=info collector=time 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-25T05:13:13.638 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=node_exporter.go:115 level=info collector=uname 2024-05-25T05:13:13.639 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-25T05:13:13.639 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-25T05:13:13.639 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-25T05:13:13.639 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-25T05:13:13.639 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[42535]: ts=2024-05-25T05:13:13.321Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-25T05:13:13.639 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 bash[42486]: 25581f6d105b1b97f0495fb1868a9237c1a35cdc4ba16434e2c9b85d1f464ac9 2024-05-25T05:13:13.639 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:13:13 smithi136 systemd[1]: Started Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:13:13.755 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:13.792 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:13.809 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:14 smithi136 ceph-mon[25618]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:14 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:14.158 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:14 smithi088 ceph-mon[29649]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:14.158 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:14 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:14.159 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:14 smithi088 ceph-mon[24736]: pgmap v19: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:14.159 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:14 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:15.182 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:15 smithi136 ceph-mon[25618]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:13:15.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:15 smithi088 ceph-mon[29649]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:13:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:15 smithi088 ceph-mon[24736]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:13:16.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:16 smithi136 ceph-mon[25618]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:16.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:16 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:16.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:16 smithi088 ceph-mon[29649]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:16 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:16 smithi088 ceph-mon[24736]: pgmap v20: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:16 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:17.251 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:17 smithi088 ceph-mon[24736]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:17.251 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:17 smithi088 ceph-mon[29649]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:17.293 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:17 smithi136 ceph-mon[25618]: pgmap v21: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:18.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:18 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:13:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:19.525 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:19 smithi088 ceph-mon[24736]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:19.526 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:19 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:19.526 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:19 smithi088 ceph-mon[29649]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:19.526 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:19 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:19.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:19 smithi136 ceph-mon[25618]: pgmap v22: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:19.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:19 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:19.970 INFO:teuthology.orchestra.run.smithi088.stdout:167503724565 2024-05-25T05:13:19.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.5 2024-05-25T05:13:20.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:13:19] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:21.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:13:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:21.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:20 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:21.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:20 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:20 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:20 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:20 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:20 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:21.853 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:21.855 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:21.858 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:21.859 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:21 smithi136 ceph-mon[25618]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:21 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:22.240 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:21 smithi088 ceph-mon[29649]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:22.240 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:21 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:22.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:21 smithi088 ceph-mon[24736]: pgmap v23: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:22.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:21 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:22.470 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:23.785 INFO:teuthology.orchestra.run.smithi088.stdout:111669149728 2024-05-25T05:13:23.786 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.3 2024-05-25T05:13:24.000 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:23 smithi088 ceph-mon[24736]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:24.000 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:23 smithi088 ceph-mon[29649]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:24.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:23 smithi136 ceph-mon[25618]: pgmap v24: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:24.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:13:24] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:24.407 INFO:teuthology.orchestra.run.smithi088.stdout:34359738414 2024-05-25T05:13:24.407 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.0 2024-05-25T05:13:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:25 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:25 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:25 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:25 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:25.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:25 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:25.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:25 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:26.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:26 smithi088 ceph-mon[29649]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:26.182 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:26 smithi088 ceph-mon[24736]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:26.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:26 smithi136 ceph-mon[25618]: pgmap v25: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:28.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:28 smithi088 ceph-mon[24736]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:28.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:28 smithi088 ceph-mon[29649]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:28 smithi136 ceph-mon[25618]: pgmap v26: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:30.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:30 smithi088 ceph-mon[24736]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:30 smithi088 ceph-mon[29649]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:30 smithi136 ceph-mon[25618]: pgmap v27: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:32.255 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:32 smithi088 ceph-mon[29649]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:32.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:32 smithi088 ceph-mon[24736]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:32.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:32 smithi136 ceph-mon[25618]: pgmap v28: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:34.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:34 smithi088 ceph-mon[29649]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:34 smithi088 ceph-mon[24736]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:34 smithi136 ceph-mon[25618]: pgmap v29: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:34.544 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:35.021 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:35.402 INFO:teuthology.orchestra.run.smithi088.stdout:201863462933 2024-05-25T05:13:35.402 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.6 2024-05-25T05:13:36.031 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:13:35] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:36.094 INFO:teuthology.orchestra.run.smithi088.stdout:133143986203 2024-05-25T05:13:36.094 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.4 2024-05-25T05:13:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:36 smithi088 ceph-mon[29649]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:36.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:36 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:36.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:36 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:36 smithi088 ceph-mon[24736]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:36 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:36 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:36 smithi136 ceph-mon[25618]: pgmap v30: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:36 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:36 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:37.195 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:37.395 INFO:teuthology.orchestra.run.smithi088.stdout:167503724568 2024-05-25T05:13:38.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:38 smithi088 ceph-mon[29649]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:38 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3789668279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-25T05:13:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:38 smithi088 ceph-mon[24736]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:38 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3789668279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-25T05:13:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:38 smithi136 ceph-mon[25618]: pgmap v31: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:38 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3789668279' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 5}]: dispatch 2024-05-25T05:13:40.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:40 smithi088 ceph-mon[24736]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:40.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:40 smithi088 ceph-mon[29649]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:40.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:40 smithi136 ceph-mon[25618]: pgmap v32: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:41.116 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:13:41.116 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:13:41.117 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:13:41.117 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:13:41.143 INFO:teuthology.orchestra.run.smithi088.stdout:77309411368 2024-05-25T05:13:41.144 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.2 2024-05-25T05:13:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:13:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:13:42.214 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:42 smithi088 ceph-mon[29649]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:42.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:42 smithi088 ceph-mon[24736]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:42.240 INFO:teuthology.orchestra.run.smithi088.stdout:55834574893 2024-05-25T05:13:42.240 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.1 2024-05-25T05:13:42.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:42 smithi136 ceph-mon[25618]: pgmap v33: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:43 smithi088 ceph-mon[24736]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:43 smithi088 ceph-mon[29649]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:43 smithi136 ceph-mon[25618]: pgmap v34: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:43.512 INFO:tasks.cephadm.ceph_manager.ceph:need seq 167503724565 got 167503724568 for osd.5 2024-05-25T05:13:43.512 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:43.933 INFO:teuthology.orchestra.run.smithi088.stdout:236223201297 2024-05-25T05:13:43.933 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph osd last-stat-seq osd.7 2024-05-25T05:13:44.197 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:44.386 INFO:teuthology.orchestra.run.smithi088.stdout:201863462935 2024-05-25T05:13:44.387 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:13:44] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:45.078 INFO:teuthology.orchestra.run.smithi088.stdout:111669149732 2024-05-25T05:13:45.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:45 smithi136 ceph-mon[25618]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:45.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:45 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:45.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:45 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:45.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:45 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1459011719' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-25T05:13:45.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:45 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1713270581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[29649]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1459011719' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1713270581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[24736]: pgmap v35: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:45.417 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1459011719' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 6}]: dispatch 2024-05-25T05:13:45.418 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:45 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1713270581' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 3}]: dispatch 2024-05-25T05:13:45.523 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:45.780 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:46.031 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:45 smithi088 systemd[1]: Starting Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:13:46.425 INFO:tasks.cephadm.ceph_manager.ceph:need seq 111669149728 got 111669149732 for osd.3 2024-05-25T05:13:46.426 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:47.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:47 smithi088 ceph-mon[24736]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:47.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:47 smithi088 ceph-mon[29649]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:47.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:47 smithi136 ceph-mon[25618]: pgmap v36: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:47.866 INFO:tasks.cephadm.ceph_manager.ceph:need seq 201863462933 got 201863462935 for osd.6 2024-05-25T05:13:47.866 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:48.250 INFO:teuthology.orchestra.run.smithi088.stdout:34359738419 2024-05-25T05:13:49.384 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:49 smithi088 ceph-mon[24736]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:49.384 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:49 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1576011697' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-25T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:49 smithi088 ceph-mon[29649]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:49.384 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:49 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1576011697' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-25T05:13:49.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:49 smithi136 ceph-mon[25618]: pgmap v37: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:49.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:49 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1576011697' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 0}]: dispatch 2024-05-25T05:13:50.005 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:13:50.959 INFO:teuthology.orchestra.run.smithi088.stdout:133143986207 2024-05-25T05:13:51.235 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:51 smithi136 ceph-mon[25618]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:51.236 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:51 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3193509404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-25T05:13:51.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:51 smithi088 ceph-mon[24736]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:51.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:51 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3193509404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-25T05:13:51.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:51 smithi088 ceph-mon[29649]: pgmap v38: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:51.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:51 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3193509404' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 4}]: dispatch 2024-05-25T05:13:51.565 INFO:teuthology.orchestra.run.smithi088.stdout:55834574895 2024-05-25T05:13:52.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:52 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2911744249' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-25T05:13:52.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:52 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2911744249' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-25T05:13:52.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:52 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2911744249' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 1}]: dispatch 2024-05-25T05:13:53.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:53 smithi136 ceph-mon[25618]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:53.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:53 smithi088 ceph-mon[24736]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:53.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:53 smithi088 ceph-mon[29649]: pgmap v39: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:54.031 INFO:tasks.cephadm.ceph_manager.ceph:need seq 133143986203 got 133143986207 for osd.4 2024-05-25T05:13:54.031 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:54.550 INFO:tasks.cephadm.ceph_manager.ceph:need seq 34359738414 got 34359738419 for osd.0 2024-05-25T05:13:54.550 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:55.004 INFO:tasks.cephadm.ceph_manager.ceph:need seq 55834574893 got 55834574895 for osd.1 2024-05-25T05:13:55.005 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:55.375 INFO:teuthology.orchestra.run.smithi088.stdout:236223201300 2024-05-25T05:13:55.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:55 smithi088 ceph-mon[29649]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:55.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:55 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3484980996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-25T05:13:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:55 smithi088 ceph-mon[24736]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:55 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3484980996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-25T05:13:55.557 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:55 smithi088 podman[49137]: 2024-05-25 05:13:55.201108693 +0000 UTC m=+1.149443891 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-05-25T05:13:55.557 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:55 smithi088 podman[49137]: 2024-05-25 05:13:55.30685961 +0000 UTC m=+1.255194800 volume create a1e2c9be943094a5ce91fcf5d6a5b39b5aa6e112f84eb67f04884fbe806bd905 2024-05-25T05:13:55.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:55 smithi136 ceph-mon[25618]: pgmap v40: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:55.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:55 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3484980996' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 7}]: dispatch 2024-05-25T05:13:56.036 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:55 smithi088 podman[49137]: 2024-05-25 05:13:55.826779476 +0000 UTC m=+1.775114667 container create 43b810a77ed38d797ec84cd286dff89315acd69244b49d53cbddc3112521a443 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:13:56.402 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:13:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:56.402 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 podman[49137]: 2024-05-25 05:13:56.162988415 +0000 UTC m=+2.111323598 container init 43b810a77ed38d797ec84cd286dff89315acd69244b49d53cbddc3112521a443 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 podman[49137]: 2024-05-25 05:13:56.165929128 +0000 UTC m=+2.114264319 container start 43b810a77ed38d797ec84cd286dff89315acd69244b49d53cbddc3112521a443 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.176Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.176Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.177Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.88 port=9094 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.179Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.204Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.204Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.206Z caller=main.go:518 msg=Listening address=:9093 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:56.206Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 bash[49137]: 43b810a77ed38d797ec84cd286dff89315acd69244b49d53cbddc3112521a443 2024-05-25T05:13:56.403 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:56 smithi088 systemd[1]: Started Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:13:56.981 INFO:tasks.cephadm.ceph_manager.ceph:need seq 236223201297 got 236223201300 for osd.7 2024-05-25T05:13:56.981 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:57.278 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.278 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.278 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:57.278 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.278 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.278 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.278 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[29649]: Deploying daemon grafana.a on smithi136 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:13:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:13:57.280 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.280 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:57 smithi088 ceph-mon[24736]: Deploying daemon grafana.a on smithi136 2024-05-25T05:13:57.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: pgmap v41: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:13:57.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:57 smithi136 ceph-mon[25618]: Deploying daemon grafana.a on smithi136 2024-05-25T05:13:58.073 INFO:teuthology.orchestra.run.smithi088.stdout:77309411371 2024-05-25T05:13:58.179 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:58 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2593410937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-25T05:13:58.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:58 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2593410937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-25T05:13:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:58 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2593410937' entity='client.admin' cmd=[{"prefix": "osd last-stat-seq", "id": 2}]: dispatch 2024-05-25T05:13:58.556 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:13:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:13:58.180Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000922782s 2024-05-25T05:13:58.911 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:13:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:13:58] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:13:59.472 INFO:tasks.cephadm.ceph_manager.ceph:need seq 77309411368 got 77309411371 for osd.2 2024-05-25T05:13:59.472 DEBUG:teuthology.parallel:result is None 2024-05-25T05:13:59.472 INFO:tasks.cephadm.ceph_manager.ceph:waiting for clean 2024-05-25T05:13:59.473 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-25T05:14:00.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:59 smithi088 ceph-mon[29649]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:00.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:13:59 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:00.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:59 smithi088 ceph-mon[24736]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:00.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:13:59 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:59 smithi136 ceph-mon[25618]: pgmap v42: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:13:59 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:00.865 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:14:01.407 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:01 smithi088 ceph-mon[24736]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:01.408 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:01 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:01.408 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:01 smithi088 ceph-mon[29649]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:01.408 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:01 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:01.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:01 smithi136 ceph-mon[25618]: pgmap v43: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:01.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:01 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:02.515 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:14:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:03.490 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:14:03.492 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-05-25T05:14:03.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:03 smithi088 ceph-mon[29649]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:03.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:03.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:03 smithi088 ceph-mon[24736]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:03.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:03 smithi136 ceph-mon[25618]: pgmap v44: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:04.348 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":44,"stamp":"2024-05-25T05:14:02.105236+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48972,"kb_used_data":6156,"kb_used_omap":0,"kb_used_meta":42752,"kb_avail":749912244,"statfs":{"total":767960285184,"available":767910137856,"internally_reserved":0,"allocated":6303744,"data_stored":3511211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43778048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.001915"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":267,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-25T05:12:40.167287+0000","last_change":"2024-05-25T05:12:26.206534+0000","last_active":"2024-05-25T05:12:40.167287+0000","last_peered":"2024-05-25T05:12:40.167287+0000","last_clean":"2024-05-25T05:12:40.167287+0000","last_became_active":"2024-05-25T05:12:26.206083+0000","last_became_peered":"2024-05-25T05:12:26.206083+0000","last_unstale":"2024-05-25T05:12:40.167287+0000","last_undegraded":"2024-05-25T05:12:40.167287+0000","last_fullsized":"2024-05-25T05:12:40.167287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-25T05:10:31.072761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-25T05:10:31.072761+0000","last_clean_scrub_stamp":"2024-05-25T05:10:31.072761+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-26T07:15:45.420560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.436},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38}]},{"osd":3,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.372}]},{"osd":5,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.35899999999999999}]},{"osd":6,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44500000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462939,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.76200000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.089,"5min":0.63300000000000001,"15min":0.55700000000000005},"min":{"1min":0.41099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":10.813000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.39100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.748,"15min":0.748},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.42499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73599999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72499999999999998,"5min":0.88,"15min":0.88},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65800000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.34899999999999998}]},{"osd":5,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69499999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.436}]},{"osd":7,"last update":"Sat May 25 05:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6340,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738812,"statfs":{"total":95995035648,"available":95988543488,"internally_reserved":0,"allocated":585728,"data_stored":240395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.311},"min":{"1min":0.252,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.433},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.318},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat May 25 05:13:35 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.38700000000000001,"15min":0.375},"min":{"1min":0.251,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.41899999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.495}]},{"osd":4,"last update":"Sat May 25 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat May 25 05:13:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81000000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat May 25 05:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat May 25 05:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.315},"min":{"1min":0.23599999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.33000000000000002,"15min":0.31},"min":{"1min":0.24399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat May 25 05:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.23899999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat May 25 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.40899999999999997,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.48299999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.40000000000000002}]},{"osd":4,"last update":"Sat May 25 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67100000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.62}]},{"osd":5,"last update":"Sat May 25 05:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58299999999999996}]},{"osd":7,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.629}]}]},{"osd":2,"up_from":18,"seq":77309411373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6276,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738876,"statfs":{"total":95995035648,"available":95988609024,"internally_reserved":0,"allocated":585728,"data_stored":240395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.223,"15min":0.223},"max":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.31},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38400000000000001,"15min":0.38300000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.628,"15min":0.628},"last":0.21299999999999999}]},{"osd":1,"last update":"Sat May 25 05:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51100000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.53600000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.22700000000000001}]},{"osd":3,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.433},"min":{"1min":0.29799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78500000000000003,"5min":0.876,"15min":0.876},"last":0.496},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80000000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat May 25 05:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41099999999999998}]},{"osd":6,"last update":"Sat May 25 05:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70399999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149736,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.40000000000000002,"15min":0.41199999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39600000000000002,"15min":0.39500000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46899999999999997,"15min":0.48599999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66100000000000003,"5min":1.409,"15min":1.409},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":1.349,"15min":1.349},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat May 25 05:13:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77000000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83799999999999997,"5min":1.482,"15min":1.482},"last":0.57999999999999996}]},{"osd":5,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.433,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.627}]},{"osd":7,"last update":"Sat May 25 05:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60199999999999998}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.5,"15min":0.503},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.59599999999999997,"5min":0.622,"15min":0.622},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68799999999999994,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65000000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat May 25 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.314,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44400000000000001,"15min":0.436},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.54100000000000004}]},{"osd":7,"last update":"Sat May 25 05:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.63900000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5700,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739452,"statfs":{"total":95995035648,"available":95989198848,"internally_reserved":0,"allocated":585728,"data_stored":240337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.442},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.39400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.443,"15min":0.437},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67100000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.379}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.501}]},{"osd":7,"last update":"Sat May 25 05:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-25T05:14:04.350 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph pg dump --format=json 2024-05-25T05:14:04.609 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:04 smithi088 ceph-mon[29649]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-25T05:14:04.610 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:04 smithi088 ceph-mon[24736]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-25T05:14:04.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:04 smithi136 ceph-mon[25618]: from='client.24508 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-25T05:14:05.108 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:14:05.361 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:14:05] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:05.361 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:14:05] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:05.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[29649]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:05.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[24736]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:05.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:05 smithi136 ceph-mon[25618]: pgmap v45: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:05.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:06.387 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:14:06.183Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003735389s 2024-05-25T05:14:06.768 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:14:06.770 INFO:teuthology.orchestra.run.smithi088.stderr:dumped all 2024-05-25T05:14:07.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:07 smithi088 ceph-mon[24736]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:07.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:07 smithi088 ceph-mon[24736]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-25T05:14:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:07 smithi088 ceph-mon[29649]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:07 smithi088 ceph-mon[29649]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-25T05:14:07.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:07 smithi136 ceph-mon[25618]: pgmap v46: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:07.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:07 smithi136 ceph-mon[25618]: from='client.24514 -' entity='client.admin' cmd=[{"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}]: dispatch 2024-05-25T05:14:08.867 INFO:teuthology.orchestra.run.smithi088.stdout:{"pg_ready":true,"pg_map":{"version":46,"stamp":"2024-05-25T05:14:06.106136+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":3,"num_osds":8,"num_per_pool_osds":3,"num_per_pool_omap_osds":3,"kb":749961216,"kb_used":48972,"kb_used_data":6156,"kb_used_omap":0,"kb_used_meta":42752,"kb_avail":749912244,"statfs":{"total":767960285184,"available":767910137856,"internally_reserved":0,"allocated":6303744,"data_stored":3511211,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":43778048},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.002203"},"pg_stats":[{"pgid":"1.0","version":"60'128","reported_seq":267,"reported_epoch":60,"state":"active+clean","last_fresh":"2024-05-25T05:12:40.167287+0000","last_change":"2024-05-25T05:12:26.206534+0000","last_active":"2024-05-25T05:12:40.167287+0000","last_peered":"2024-05-25T05:12:40.167287+0000","last_clean":"2024-05-25T05:12:40.167287+0000","last_became_active":"2024-05-25T05:12:26.206083+0000","last_became_peered":"2024-05-25T05:12:26.206083+0000","last_unstale":"2024-05-25T05:12:40.167287+0000","last_undegraded":"2024-05-25T05:12:40.167287+0000","last_fullsized":"2024-05-25T05:12:40.167287+0000","mapping_epoch":58,"log_start":"0'0","ondisk_log_start":"0'0","created":20,"last_epoch_clean":59,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-05-25T05:10:31.072761+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-05-25T05:10:31.072761+0000","last_clean_scrub_stamp":"2024-05-25T05:10:31.072761+0000","objects_scrubbed":0,"log_size":128,"ondisk_log_size":128,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-05-26T07:15:45.420560+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[7,0,6],"acting":[7,0,6],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":7,"acting_primary":7,"purged_snaps":[]}],"pool_stats":[{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":212,"num_read_kb":306,"num_write":179,"num_write_kb":2416,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":6,"num_bytes_recovered":1586784,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1597440,"data_stored":1586784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":128,"ondisk_log_size":128,"up":3,"acting":3,"num_store_stats":3}],"osd_stats":[{"osd":7,"up_from":55,"seq":236223201302,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6096,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":4992,"kb_avail":93739056,"statfs":{"total":95995035648,"available":95988793344,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5111808},"hb_peers":[0,1,2,3,4,5,6],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.79600000000000004,"5min":0.79600000000000004,"15min":0.79600000000000004},"last":0.32700000000000001},{"interface":"front","average":{"1min":0.53200000000000003,"5min":0.53200000000000003,"15min":0.53200000000000003},"min":{"1min":0.38500000000000001,"5min":0.38500000000000001,"15min":0.38500000000000001},"max":{"1min":0.80100000000000005,"5min":0.80100000000000005,"15min":0.80100000000000005},"last":0.41499999999999998}]},{"osd":1,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.54200000000000004,"15min":0.54200000000000004},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.84199999999999997,"5min":0.84199999999999997,"15min":0.84199999999999997},"last":0.436},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.375,"5min":0.375,"15min":0.375},"max":{"1min":0.78700000000000003,"5min":0.78700000000000003,"15min":0.78700000000000003},"last":0.39100000000000001}]},{"osd":2,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.50600000000000001,"5min":0.50600000000000001,"15min":0.50600000000000001},"min":{"1min":0.36499999999999999,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.754,"5min":0.754,"15min":0.754},"last":0.42499999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.53400000000000003,"15min":0.53400000000000003},"min":{"1min":0.41799999999999998,"5min":0.41799999999999998,"15min":0.41799999999999998},"max":{"1min":0.81399999999999995,"5min":0.81399999999999995,"15min":0.81399999999999995},"last":0.38}]},{"osd":3,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52200000000000002,"15min":0.52200000000000002},"min":{"1min":0.38600000000000001,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.96399999999999997,"5min":0.96399999999999997,"15min":0.96399999999999997},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.55400000000000005,"5min":0.55400000000000005,"15min":0.55400000000000005},"min":{"1min":0.42599999999999999,"5min":0.42599999999999999,"15min":0.42599999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.40600000000000003}]},{"osd":4,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.40799999999999997,"5min":0.40799999999999997,"15min":0.40799999999999997},"min":{"1min":0.247,"5min":0.247,"15min":0.247},"max":{"1min":0.65300000000000002,"5min":0.65300000000000002,"15min":0.65300000000000002},"last":0.311},{"interface":"front","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.27800000000000002,"5min":0.27800000000000002,"15min":0.27800000000000002},"max":{"1min":0.63100000000000001,"5min":0.63100000000000001,"15min":0.63100000000000001},"last":0.372}]},{"osd":5,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.41999999999999998,"5min":0.41999999999999998,"15min":0.41999999999999998},"min":{"1min":0.30399999999999999,"5min":0.30399999999999999,"15min":0.30399999999999999},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.34399999999999997},{"interface":"front","average":{"1min":0.44900000000000001,"5min":0.44900000000000001,"15min":0.44900000000000001},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.35899999999999999}]},{"osd":6,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.48199999999999998,"15min":0.48199999999999998},"min":{"1min":0.318,"5min":0.318,"15min":0.318},"max":{"1min":0.72999999999999998,"5min":0.72999999999999998,"15min":0.72999999999999998},"last":0.44800000000000001},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.68600000000000005,"5min":0.68600000000000005,"15min":0.68600000000000005},"last":0.44500000000000001}]}]},{"osd":6,"up_from":47,"seq":201863462939,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6160,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5056,"kb_avail":93738992,"statfs":{"total":95995035648,"available":95988727808,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5177344},"hb_peers":[0,1,2,3,4,5,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.51400000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.35599999999999998,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.76200000000000001,"5min":0.82599999999999996,"15min":0.82599999999999996},"last":0.50600000000000001},{"interface":"front","average":{"1min":1.089,"5min":0.63300000000000001,"15min":0.55700000000000005},"min":{"1min":0.41099999999999998,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":10.813000000000001,"5min":10.813000000000001,"15min":10.813000000000001},"last":0.49399999999999999}]},{"osd":1,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.50700000000000001,"5min":0.52900000000000003,"15min":0.53300000000000003},"min":{"1min":0.35699999999999998,"5min":0.29899999999999999,"15min":0.29899999999999999},"max":{"1min":0.78000000000000003,"5min":0.81699999999999995,"15min":0.81699999999999995},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.53400000000000003,"5min":0.51600000000000001,"15min":0.51300000000000001},"min":{"1min":0.39100000000000001,"5min":0.32400000000000001,"15min":0.32400000000000001},"max":{"1min":0.71699999999999997,"5min":0.748,"15min":0.748},"last":0.47299999999999998}]},{"osd":2,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54200000000000004,"5min":0.53700000000000003,"15min":0.53600000000000003},"min":{"1min":0.42499999999999999,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.748,"5min":0.748,"15min":0.748},"last":0.52600000000000002},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.53100000000000003,"15min":0.53200000000000003},"min":{"1min":0.373,"5min":0.36399999999999999,"15min":0.36399999999999999},"max":{"1min":0.73599999999999999,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.46000000000000002}]},{"osd":3,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.54300000000000004,"5min":0.52300000000000002,"15min":0.51900000000000002},"min":{"1min":0.40000000000000002,"5min":0.35999999999999999,"15min":0.35999999999999999},"max":{"1min":0.73399999999999999,"5min":0.73399999999999999,"15min":0.73399999999999999},"last":0.40000000000000002},{"interface":"front","average":{"1min":0.57399999999999995,"5min":0.56499999999999995,"15min":0.56299999999999994},"min":{"1min":0.39900000000000002,"5min":0.39900000000000002,"15min":0.39900000000000002},"max":{"1min":0.72499999999999998,"5min":0.88,"15min":0.88},"last":0.55000000000000004}]},{"osd":4,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.45900000000000002,"5min":0.43099999999999999,"15min":0.42699999999999999},"min":{"1min":0.308,"5min":0.27300000000000002,"15min":0.27300000000000002},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.38100000000000001},{"interface":"front","average":{"1min":0.48199999999999998,"5min":0.46500000000000002,"15min":0.46200000000000002},"min":{"1min":0.32500000000000001,"5min":0.28699999999999998,"15min":0.28699999999999998},"max":{"1min":0.65800000000000003,"5min":0.80400000000000005,"15min":0.80400000000000005},"last":0.34899999999999998}]},{"osd":5,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.497,"5min":0.44700000000000001,"15min":0.439},"min":{"1min":0.29499999999999998,"5min":0.29499999999999998,"15min":0.29499999999999998},"max":{"1min":0.78100000000000003,"5min":0.78100000000000003,"15min":0.78100000000000003},"last":0.56799999999999995},{"interface":"front","average":{"1min":0.505,"5min":0.47399999999999998,"15min":0.46899999999999997},"min":{"1min":0.33200000000000002,"5min":0.33200000000000002,"15min":0.33200000000000002},"max":{"1min":0.69499999999999995,"5min":0.85199999999999998,"15min":0.85199999999999998},"last":0.436}]},{"osd":7,"last update":"Sat May 25 05:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.48499999999999999,"5min":0.48499999999999999,"15min":0.48499999999999999},"min":{"1min":0.36099999999999999,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.72099999999999997,"5min":0.72099999999999997,"15min":0.72099999999999997},"last":0.44400000000000001},{"interface":"front","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.69399999999999995,"5min":0.69399999999999995,"15min":0.69399999999999995},"last":0.48399999999999999}]}]},{"osd":1,"up_from":13,"seq":55834574898,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6340,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5760,"kb_avail":93738812,"statfs":{"total":95995035648,"available":95988543488,"internally_reserved":0,"allocated":585728,"data_stored":240395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5898240},"hb_peers":[0,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:13 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.33200000000000002,"15min":0.311},"min":{"1min":0.252,"5min":0.20499999999999999,"15min":0.20499999999999999},"max":{"1min":0.76800000000000002,"5min":0.76800000000000002,"15min":0.76800000000000002},"last":0.433},{"interface":"front","average":{"1min":0.40600000000000003,"5min":0.34000000000000002,"15min":0.318},"min":{"1min":0.28899999999999998,"5min":0.222,"15min":0.222},"max":{"1min":0.751,"5min":0.751,"15min":0.751},"last":0.45000000000000001}]},{"osd":2,"last update":"Sat May 25 05:13:35 2024","interfaces":[{"interface":"back","average":{"1min":0.42399999999999999,"5min":0.38700000000000001,"15min":0.375},"min":{"1min":0.251,"5min":0.23799999999999999,"15min":0.23799999999999999},"max":{"1min":0.92000000000000004,"5min":0.92000000000000004,"15min":0.92000000000000004},"last":0.39500000000000002},{"interface":"front","average":{"1min":0.40899999999999997,"5min":0.39300000000000002,"15min":0.38800000000000001},"min":{"1min":0.26900000000000002,"5min":0.26400000000000001,"15min":0.26400000000000001},"max":{"1min":0.78500000000000003,"5min":0.78500000000000003,"15min":0.78500000000000003},"last":0.40799999999999997}]},{"osd":3,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.375,"5min":0.40500000000000003,"15min":0.41899999999999998},"min":{"1min":0.25700000000000001,"5min":0.25700000000000001,"15min":0.25700000000000001},"max":{"1min":0.80000000000000004,"5min":0.80000000000000004,"15min":0.80000000000000004},"last":0.48699999999999999},{"interface":"front","average":{"1min":0.40699999999999997,"5min":0.443,"15min":0.45100000000000001},"min":{"1min":0.32400000000000001,"5min":0.29799999999999999,"15min":0.29799999999999999},"max":{"1min":0.86499999999999999,"5min":0.86499999999999999,"15min":0.86499999999999999},"last":0.495}]},{"osd":4,"last update":"Sat May 25 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.54100000000000004,"5min":0.52800000000000002,"15min":0.52600000000000002},"min":{"1min":0.312,"5min":0.312,"15min":0.312},"max":{"1min":0.94299999999999995,"5min":0.94299999999999995,"15min":0.94299999999999995},"last":0.53300000000000003},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.56399999999999995,"15min":0.56000000000000005},"min":{"1min":0.41499999999999998,"5min":0.35499999999999998,"15min":0.35499999999999998},"max":{"1min":1.0620000000000001,"5min":1.0620000000000001,"15min":1.0620000000000001},"last":0.55300000000000005}]},{"osd":5,"last update":"Sat May 25 05:13:42 2024","interfaces":[{"interface":"back","average":{"1min":0.56399999999999995,"5min":0.60399999999999998,"15min":0.60999999999999999},"min":{"1min":0.379,"5min":0.379,"15min":0.379},"max":{"1min":0.96899999999999997,"5min":0.96899999999999997,"15min":0.96899999999999997},"last":0.52500000000000002},{"interface":"front","average":{"1min":0.58399999999999996,"5min":0.59199999999999997,"15min":0.59399999999999997},"min":{"1min":0.44400000000000001,"5min":0.44400000000000001,"15min":0.44400000000000001},"max":{"1min":0.81000000000000005,"5min":0.82399999999999995,"15min":0.82399999999999995},"last":0.57199999999999995}]},{"osd":6,"last update":"Sat May 25 05:14:00 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.54600000000000004,"15min":0.54400000000000004},"min":{"1min":0.38400000000000001,"5min":0.36499999999999999,"15min":0.36499999999999999},"max":{"1min":0.85099999999999998,"5min":0.85099999999999998,"15min":0.85099999999999998},"last":0.56000000000000005},{"interface":"front","average":{"1min":0.56699999999999995,"5min":0.59499999999999997,"15min":0.59899999999999998},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":1.032,"5min":1.032,"15min":1.032},"last":0.61399999999999999}]},{"osd":7,"last update":"Sat May 25 05:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.60699999999999998,"5min":0.60699999999999998,"15min":0.60699999999999998},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":1.002,"5min":1.002,"15min":1.002},"last":0.59399999999999997},{"interface":"front","average":{"1min":0.59499999999999997,"5min":0.59499999999999997,"15min":0.59499999999999997},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.88800000000000001,"5min":0.88800000000000001,"15min":0.88800000000000001},"last":0.58599999999999997}]}]},{"osd":0,"up_from":8,"seq":34359738422,"num_pgs":1,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":93745152,"kb_used":6928,"kb_used_data":1096,"kb_used_omap":0,"kb_used_meta":5824,"kb_avail":93738224,"statfs":{"total":95995035648,"available":95987941376,"internally_reserved":0,"allocated":1122304,"data_stored":769588,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5963776},"hb_peers":[1,2,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":1,"last update":"Sat May 25 05:13:12 2024","interfaces":[{"interface":"back","average":{"1min":0.36399999999999999,"5min":0.33300000000000002,"15min":0.315},"min":{"1min":0.23599999999999999,"5min":0.183,"15min":0.183},"max":{"1min":0.58099999999999996,"5min":0.58099999999999996,"15min":0.58099999999999996},"last":0.39000000000000001},{"interface":"front","average":{"1min":0.378,"5min":0.33000000000000002,"15min":0.31},"min":{"1min":0.24399999999999999,"5min":0.20399999999999999,"15min":0.20399999999999999},"max":{"1min":0.66600000000000004,"5min":0.66600000000000004,"15min":0.66600000000000004},"last":0.29399999999999998}]},{"osd":2,"last update":"Sat May 25 05:13:36 2024","interfaces":[{"interface":"back","average":{"1min":0.40600000000000003,"5min":0.39900000000000002,"15min":0.39500000000000002},"min":{"1min":0.27300000000000002,"5min":0.23300000000000001,"15min":0.23300000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.33200000000000002},{"interface":"front","average":{"1min":0.40200000000000002,"5min":0.39800000000000002,"15min":0.39400000000000002},"min":{"1min":0.23899999999999999,"5min":0.217,"15min":0.217},"max":{"1min":0.67800000000000005,"5min":0.67800000000000005,"15min":0.67800000000000005},"last":0.32300000000000001}]},{"osd":3,"last update":"Sat May 25 05:13:59 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.40899999999999997,"15min":0.41699999999999998},"min":{"1min":0.27200000000000002,"5min":0.27200000000000002,"15min":0.27200000000000002},"max":{"1min":0.496,"5min":0.59099999999999997,"15min":0.59099999999999997},"last":0.35599999999999998},{"interface":"front","average":{"1min":0.38,"5min":0.40899999999999997,"15min":0.41799999999999998},"min":{"1min":0.28100000000000003,"5min":0.28100000000000003,"15min":0.28100000000000003},"max":{"1min":0.48299999999999998,"5min":0.56599999999999995,"15min":0.56599999999999995},"last":0.40000000000000002}]},{"osd":4,"last update":"Sat May 25 05:13:18 2024","interfaces":[{"interface":"back","average":{"1min":0.51000000000000001,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.67100000000000004,"5min":0.68300000000000005,"15min":0.68300000000000005},"last":0.53600000000000003},{"interface":"front","average":{"1min":0.55800000000000005,"5min":0.54100000000000004,"15min":0.53800000000000003},"min":{"1min":0.40000000000000002,"5min":0.40000000000000002,"15min":0.40000000000000002},"max":{"1min":0.81299999999999994,"5min":0.81299999999999994,"15min":0.81299999999999994},"last":0.62}]},{"osd":5,"last update":"Sat May 25 05:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.56499999999999995,"5min":0.54800000000000004,"15min":0.54500000000000004},"min":{"1min":0.42899999999999999,"5min":0.37,"15min":0.37},"max":{"1min":0.75600000000000001,"5min":0.78800000000000003,"15min":0.78800000000000003},"last":0.60499999999999998},{"interface":"front","average":{"1min":0.59899999999999998,"5min":0.58199999999999996,"15min":0.57899999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.77000000000000002,"5min":0.78900000000000003,"15min":0.78900000000000003},"last":0.57399999999999995}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.55800000000000005,"5min":0.55800000000000005,"15min":0.55800000000000005},"min":{"1min":0.40200000000000002,"5min":0.40200000000000002,"15min":0.40200000000000002},"max":{"1min":0.77100000000000002,"5min":0.77100000000000002,"15min":0.77100000000000002},"last":0.54500000000000004},{"interface":"front","average":{"1min":0.54700000000000004,"5min":0.54700000000000004,"15min":0.54700000000000004},"min":{"1min":0.40699999999999997,"5min":0.40699999999999997,"15min":0.40699999999999997},"max":{"1min":0.81799999999999995,"5min":0.81799999999999995,"15min":0.81799999999999995},"last":0.58299999999999996}]},{"osd":7,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41299999999999998,"5min":0.41299999999999998,"15min":0.41299999999999998},"max":{"1min":0.80200000000000005,"5min":0.80200000000000005,"15min":0.80200000000000005},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.60499999999999998,"5min":0.60499999999999998,"15min":0.60499999999999998},"min":{"1min":0.45500000000000002,"5min":0.45500000000000002,"15min":0.45500000000000002},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.629}]}]},{"osd":2,"up_from":18,"seq":77309411373,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":6276,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5696,"kb_avail":93738876,"statfs":{"total":95995035648,"available":95988609024,"internally_reserved":0,"allocated":585728,"data_stored":240395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5832704},"hb_peers":[0,1,3,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.35799999999999998,"5min":0.36699999999999999,"15min":0.36499999999999999},"min":{"1min":0.247,"5min":0.223,"15min":0.223},"max":{"1min":0.53900000000000003,"5min":0.55400000000000005,"15min":0.55400000000000005},"last":0.31},{"interface":"front","average":{"1min":0.36299999999999999,"5min":0.38400000000000001,"15min":0.38300000000000001},"min":{"1min":0.23599999999999999,"5min":0.23599999999999999,"15min":0.23599999999999999},"max":{"1min":0.51000000000000001,"5min":0.628,"15min":0.628},"last":0.21299999999999999}]},{"osd":1,"last update":"Sat May 25 05:13:32 2024","interfaces":[{"interface":"back","average":{"1min":0.37,"5min":0.38100000000000001,"15min":0.379},"min":{"1min":0.23100000000000001,"5min":0.23100000000000001,"15min":0.23100000000000001},"max":{"1min":0.51100000000000001,"5min":0.60099999999999998,"15min":0.60099999999999998},"last":0.19400000000000001},{"interface":"front","average":{"1min":0.39700000000000002,"5min":0.40000000000000002,"15min":0.39800000000000002},"min":{"1min":0.28899999999999998,"5min":0.246,"15min":0.246},"max":{"1min":0.53600000000000003,"5min":0.58699999999999997,"15min":0.58699999999999997},"last":0.22700000000000001}]},{"osd":3,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.38400000000000001,"5min":0.41599999999999998,"15min":0.42399999999999999},"min":{"1min":0.24399999999999999,"5min":0.24399999999999999,"15min":0.24399999999999999},"max":{"1min":0.57199999999999995,"5min":0.60399999999999998,"15min":0.60399999999999998},"last":0.24399999999999999},{"interface":"front","average":{"1min":0.39800000000000002,"5min":0.42599999999999999,"15min":0.433},"min":{"1min":0.29799999999999999,"5min":0.25900000000000001,"15min":0.25900000000000001},"max":{"1min":0.51300000000000001,"5min":0.57399999999999995,"15min":0.57399999999999995},"last":0.32100000000000001}]},{"osd":4,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.55700000000000005,"5min":0.58499999999999996,"15min":0.58999999999999997},"min":{"1min":0.316,"5min":0.316,"15min":0.316},"max":{"1min":0.78500000000000003,"5min":0.876,"15min":0.876},"last":0.496},{"interface":"front","average":{"1min":0.56499999999999995,"5min":0.58799999999999997,"15min":0.59199999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.80000000000000004,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.64200000000000002}]},{"osd":5,"last update":"Sat May 25 05:13:41 2024","interfaces":[{"interface":"back","average":{"1min":0.61399999999999999,"5min":0.58099999999999996,"15min":0.57499999999999996},"min":{"1min":0.42499999999999999,"5min":0.33500000000000002,"15min":0.33500000000000002},"max":{"1min":0.85399999999999998,"5min":0.85399999999999998,"15min":0.85399999999999998},"last":0.60399999999999998},{"interface":"front","average":{"1min":0.59099999999999997,"5min":0.59199999999999997,"15min":0.59199999999999997},"min":{"1min":0.39900000000000002,"5min":0.38400000000000001,"15min":0.38400000000000001},"max":{"1min":0.82899999999999996,"5min":0.82899999999999996,"15min":0.82899999999999996},"last":0.41099999999999998}]},{"osd":6,"last update":"Sat May 25 05:13:03 2024","interfaces":[{"interface":"back","average":{"1min":0.57499999999999996,"5min":0.57499999999999996,"15min":0.57499999999999996},"min":{"1min":0.40600000000000003,"5min":0.40600000000000003,"15min":0.40600000000000003},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.58699999999999997},{"interface":"front","average":{"1min":0.60999999999999999,"5min":0.60999999999999999,"15min":0.60999999999999999},"min":{"1min":0.39800000000000002,"5min":0.39800000000000002,"15min":0.39800000000000002},"max":{"1min":0.79000000000000004,"5min":0.79000000000000004,"15min":0.79000000000000004},"last":0.67500000000000004}]},{"osd":7,"last update":"Sat May 25 05:13:23 2024","interfaces":[{"interface":"back","average":{"1min":0.58899999999999997,"5min":0.58899999999999997,"15min":0.58899999999999997},"min":{"1min":0.41099999999999998,"5min":0.41099999999999998,"15min":0.41099999999999998},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.60899999999999999,"5min":0.60899999999999999,"15min":0.60899999999999999},"min":{"1min":0.40400000000000003,"5min":0.40400000000000003,"15min":0.40400000000000003},"max":{"1min":0.81999999999999995,"5min":0.81999999999999995,"15min":0.81999999999999995},"last":0.70399999999999996}]}]},{"osd":3,"up_from":26,"seq":111669149736,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5704,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739448,"statfs":{"total":95995035648,"available":95989194752,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,4,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.372,"5min":0.38600000000000001,"15min":0.39000000000000001},"min":{"1min":0.23200000000000001,"5min":0.23200000000000001,"15min":0.23200000000000001},"max":{"1min":0.52600000000000002,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.43099999999999999},{"interface":"front","average":{"1min":0.376,"5min":0.39700000000000002,"15min":0.40300000000000002},"min":{"1min":0.26500000000000001,"5min":0.222,"15min":0.222},"max":{"1min":0.58299999999999996,"5min":0.64400000000000002,"15min":0.64400000000000002},"last":0.41799999999999998}]},{"osd":1,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.35299999999999998,"5min":0.40000000000000002,"15min":0.41199999999999998},"min":{"1min":0.24299999999999999,"5min":0.24299999999999999,"15min":0.24299999999999999},"max":{"1min":0.62,"5min":0.62,"15min":0.62},"last":0.36499999999999999},{"interface":"front","average":{"1min":0.39000000000000001,"5min":0.39600000000000002,"15min":0.39500000000000002},"min":{"1min":0.26900000000000002,"5min":0.26900000000000002,"15min":0.26900000000000002},"max":{"1min":0.60599999999999998,"5min":0.60599999999999998,"15min":0.60599999999999998},"last":0.45600000000000002}]},{"osd":2,"last update":"Sat May 25 05:13:57 2024","interfaces":[{"interface":"back","average":{"1min":0.40500000000000003,"5min":0.46899999999999997,"15min":0.48599999999999999},"min":{"1min":0.28000000000000003,"5min":0.28000000000000003,"15min":0.28000000000000003},"max":{"1min":0.66100000000000003,"5min":1.409,"15min":1.409},"last":0.39800000000000002},{"interface":"front","average":{"1min":0.40400000000000003,"5min":0.45200000000000001,"15min":0.46800000000000003},"min":{"1min":0.29999999999999999,"5min":0.28499999999999998,"15min":0.28499999999999998},"max":{"1min":0.64900000000000002,"5min":1.349,"15min":1.349},"last":0.47299999999999998}]},{"osd":4,"last update":"Sat May 25 05:13:19 2024","interfaces":[{"interface":"back","average":{"1min":0.57399999999999995,"5min":0.56599999999999995,"15min":0.56499999999999995},"min":{"1min":0.40200000000000002,"5min":0.36099999999999999,"15min":0.36099999999999999},"max":{"1min":0.77000000000000002,"5min":1.4359999999999999,"15min":1.4359999999999999},"last":0.57299999999999995},{"interface":"front","average":{"1min":0.57999999999999996,"5min":0.58799999999999997,"15min":0.58899999999999997},"min":{"1min":0.40899999999999997,"5min":0.38800000000000001,"15min":0.38800000000000001},"max":{"1min":0.83799999999999997,"5min":1.482,"15min":1.482},"last":0.57999999999999996}]},{"osd":5,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.60399999999999998,"5min":0.55300000000000005,"15min":0.54500000000000004},"min":{"1min":0.38800000000000001,"5min":0.35599999999999998,"15min":0.35599999999999998},"max":{"1min":0.94599999999999995,"5min":0.94599999999999995,"15min":0.94599999999999995},"last":0.58799999999999997},{"interface":"front","average":{"1min":0.58899999999999997,"5min":0.56000000000000005,"15min":0.55500000000000005},"min":{"1min":0.433,"5min":0.39600000000000002,"15min":0.39600000000000002},"max":{"1min":0.95299999999999996,"5min":0.95299999999999996,"15min":0.95299999999999996},"last":0.54400000000000004}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.58999999999999997,"5min":0.58999999999999997,"15min":0.58999999999999997},"min":{"1min":0.42699999999999999,"5min":0.42699999999999999,"15min":0.42699999999999999},"max":{"1min":0.86299999999999999,"5min":0.86299999999999999,"15min":0.86299999999999999},"last":0.55200000000000005},{"interface":"front","average":{"1min":0.56100000000000005,"5min":0.56100000000000005,"15min":0.56100000000000005},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.749,"5min":0.749,"15min":0.749},"last":0.627}]},{"osd":7,"last update":"Sat May 25 05:13:22 2024","interfaces":[{"interface":"back","average":{"1min":0.58699999999999997,"5min":0.58699999999999997,"15min":0.58699999999999997},"min":{"1min":0.41699999999999998,"5min":0.41699999999999998,"15min":0.41699999999999998},"max":{"1min":0.73799999999999999,"5min":0.73799999999999999,"15min":0.73799999999999999},"last":0.64300000000000002},{"interface":"front","average":{"1min":0.59399999999999997,"5min":0.59399999999999997,"15min":0.59399999999999997},"min":{"1min":0.44800000000000001,"5min":0.44800000000000001,"15min":0.44800000000000001},"max":{"1min":0.76400000000000001,"5min":0.76400000000000001,"15min":0.76400000000000001},"last":0.60199999999999998}]}]},{"osd":4,"up_from":31,"seq":133143986210,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5768,"kb_used_data":576,"kb_used_omap":0,"kb_used_meta":5184,"kb_avail":93739384,"statfs":{"total":95995035648,"available":95989129216,"internally_reserved":0,"allocated":589824,"data_stored":240660,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5308416},"hb_peers":[0,1,2,3,5,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.48399999999999999,"5min":0.5,"15min":0.503},"min":{"1min":0.34200000000000003,"5min":0.34200000000000003,"15min":0.34200000000000003},"max":{"1min":0.59599999999999997,"5min":0.622,"15min":0.622},"last":0.68400000000000005},{"interface":"front","average":{"1min":0.5,"5min":0.53200000000000003,"15min":0.53700000000000003},"min":{"1min":0.38,"5min":0.35299999999999998,"15min":0.35299999999999998},"max":{"1min":0.64100000000000001,"5min":0.71099999999999997,"15min":0.71099999999999997},"last":0.53000000000000003}]},{"osd":1,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.502,"5min":0.51800000000000002,"15min":0.52000000000000002},"min":{"1min":0.37,"5min":0.37,"15min":0.37},"max":{"1min":0.68400000000000005,"5min":0.69599999999999995,"15min":0.69599999999999995},"last":0.69899999999999995},{"interface":"front","average":{"1min":0.52400000000000002,"5min":0.52500000000000002,"15min":0.52500000000000002},"min":{"1min":0.39400000000000002,"5min":0.39300000000000002,"15min":0.39300000000000002},"max":{"1min":0.68799999999999994,"5min":0.72499999999999998,"15min":0.72499999999999998},"last":0.58899999999999997}]},{"osd":2,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.52200000000000002,"5min":0.52900000000000003,"15min":0.53000000000000003},"min":{"1min":0.36599999999999999,"5min":0.34599999999999997,"15min":0.34599999999999997},"max":{"1min":0.64900000000000002,"5min":0.69299999999999995,"15min":0.69299999999999995},"last":0.61699999999999999},{"interface":"front","average":{"1min":0.503,"5min":0.53000000000000003,"15min":0.53400000000000003},"min":{"1min":0.38300000000000001,"5min":0.38300000000000001,"15min":0.38300000000000001},"max":{"1min":0.65800000000000003,"5min":0.67400000000000004,"15min":0.67400000000000004},"last":0.64400000000000002}]},{"osd":3,"last update":"Sat May 25 05:13:20 2024","interfaces":[{"interface":"back","average":{"1min":0.51500000000000001,"5min":0.52300000000000002,"15min":0.52400000000000002},"min":{"1min":0.38900000000000001,"5min":0.38200000000000001,"15min":0.38200000000000001},"max":{"1min":0.66000000000000003,"5min":0.66000000000000003,"15min":0.66000000000000003},"last":0.60899999999999999},{"interface":"front","average":{"1min":0.53600000000000003,"5min":0.53000000000000003,"15min":0.52900000000000003},"min":{"1min":0.41699999999999998,"5min":0.38900000000000001,"15min":0.38900000000000001},"max":{"1min":0.65000000000000002,"5min":0.68000000000000005,"15min":0.68000000000000005},"last":0.66300000000000003}]},{"osd":5,"last update":"Sat May 25 05:13:38 2024","interfaces":[{"interface":"back","average":{"1min":0.46200000000000002,"5min":0.41499999999999998,"15min":0.40699999999999997},"min":{"1min":0.314,"5min":0.27000000000000002,"15min":0.27000000000000002},"max":{"1min":0.67100000000000004,"5min":0.67100000000000004,"15min":0.67100000000000004},"last":0.47999999999999998},{"interface":"front","average":{"1min":0.49399999999999999,"5min":0.44400000000000001,"15min":0.436},"min":{"1min":0.31900000000000001,"5min":0.31900000000000001,"15min":0.31900000000000001},"max":{"1min":0.67300000000000004,"5min":0.67300000000000004,"15min":0.67300000000000004},"last":0.56200000000000006}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.44500000000000001,"5min":0.44500000000000001,"15min":0.44500000000000001},"min":{"1min":0.27500000000000002,"5min":0.27500000000000002,"15min":0.27500000000000002},"max":{"1min":0.621,"5min":0.621,"15min":0.621},"last":0.51800000000000002},{"interface":"front","average":{"1min":0.42899999999999999,"5min":0.42899999999999999,"15min":0.42899999999999999},"min":{"1min":0.29699999999999999,"5min":0.29699999999999999,"15min":0.29699999999999999},"max":{"1min":0.58799999999999997,"5min":0.58799999999999997,"15min":0.58799999999999997},"last":0.54100000000000004}]},{"osd":7,"last update":"Sat May 25 05:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51100000000000001,"5min":0.51100000000000001,"15min":0.51100000000000001},"min":{"1min":0.317,"5min":0.317,"15min":0.317},"max":{"1min":0.65800000000000003,"5min":0.65800000000000003,"15min":0.65800000000000003},"last":0.65200000000000002},{"interface":"front","average":{"1min":0.52800000000000002,"5min":0.52800000000000002,"15min":0.52800000000000002},"min":{"1min":0.374,"5min":0.374,"15min":0.374},"max":{"1min":0.70199999999999996,"5min":0.70199999999999996,"15min":0.70199999999999996},"last":0.63900000000000001}]}]},{"osd":5,"up_from":39,"seq":167503724574,"num_pgs":0,"num_osds":1,"num_per_pool_osds":0,"num_per_pool_omap_osds":0,"kb":93745152,"kb_used":5700,"kb_used_data":572,"kb_used_omap":0,"kb_used_meta":5120,"kb_avail":93739452,"statfs":{"total":95995035648,"available":95989198848,"internally_reserved":0,"allocated":585728,"data_stored":240337,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":5242880},"hb_peers":[0,1,2,3,4,6,7],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[{"osd":0,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.54900000000000004,"5min":0.53700000000000003,"15min":0.53500000000000003},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.75900000000000001,"5min":0.75900000000000001,"15min":0.75900000000000001},"last":0.442},{"interface":"front","average":{"1min":0.56899999999999995,"5min":0.51700000000000002,"15min":0.50900000000000001},"min":{"1min":0.42599999999999999,"5min":0.38600000000000001,"15min":0.38600000000000001},"max":{"1min":0.83799999999999997,"5min":0.83799999999999997,"15min":0.83799999999999997},"last":0.41099999999999998}]},{"osd":1,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.56200000000000006,"5min":0.52900000000000003,"15min":0.52300000000000002},"min":{"1min":0.39400000000000002,"5min":0.39000000000000001,"15min":0.39000000000000001},"max":{"1min":0.82499999999999996,"5min":0.82499999999999996,"15min":0.82499999999999996},"last":0.51100000000000001},{"interface":"front","average":{"1min":0.55600000000000005,"5min":0.54000000000000004,"15min":0.53700000000000003},"min":{"1min":0.41499999999999998,"5min":0.378,"15min":0.378},"max":{"1min":0.83499999999999996,"5min":0.83499999999999996,"15min":0.83499999999999996},"last":0.36699999999999999}]},{"osd":2,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.55200000000000005,"5min":0.52600000000000002,"15min":0.52200000000000002},"min":{"1min":0.41299999999999998,"5min":0.376,"15min":0.376},"max":{"1min":0.79900000000000004,"5min":0.79900000000000004,"15min":0.79900000000000004},"last":0.41799999999999998},{"interface":"front","average":{"1min":0.57499999999999996,"5min":0.53900000000000003,"15min":0.53300000000000003},"min":{"1min":0.41199999999999998,"5min":0.39700000000000002,"15min":0.39700000000000002},"max":{"1min":0.80800000000000005,"5min":0.80800000000000005,"15min":0.80800000000000005},"last":0.52000000000000002}]},{"osd":3,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.53900000000000003,"5min":0.51900000000000002,"15min":0.51600000000000001},"min":{"1min":0.39100000000000001,"5min":0.39100000000000001,"15min":0.39100000000000001},"max":{"1min":0.90200000000000002,"5min":0.90200000000000002,"15min":0.90200000000000002},"last":0.42699999999999999},{"interface":"front","average":{"1min":0.58499999999999996,"5min":0.58099999999999996,"15min":0.57999999999999996},"min":{"1min":0.46500000000000002,"5min":0.40899999999999997,"15min":0.40899999999999997},"max":{"1min":0.84999999999999998,"5min":0.84999999999999998,"15min":0.84999999999999998},"last":0.49399999999999999}]},{"osd":4,"last update":"Sat May 25 05:13:43 2024","interfaces":[{"interface":"back","average":{"1min":0.48199999999999998,"5min":0.443,"15min":0.437},"min":{"1min":0.27400000000000002,"5min":0.27400000000000002,"15min":0.27400000000000002},"max":{"1min":0.96199999999999997,"5min":0.96199999999999997,"15min":0.96199999999999997},"last":0.53500000000000003},{"interface":"front","average":{"1min":0.47499999999999998,"5min":0.45900000000000002,"15min":0.45600000000000002},"min":{"1min":0.28899999999999998,"5min":0.28899999999999998,"15min":0.28899999999999998},"max":{"1min":0.67100000000000004,"5min":0.80500000000000005,"15min":0.80500000000000005},"last":0.379}]},{"osd":6,"last update":"Sat May 25 05:13:02 2024","interfaces":[{"interface":"back","average":{"1min":0.45600000000000002,"5min":0.45600000000000002,"15min":0.45600000000000002},"min":{"1min":0.29199999999999998,"5min":0.29199999999999998,"15min":0.29199999999999998},"max":{"1min":0.76500000000000001,"5min":0.76500000000000001,"15min":0.76500000000000001},"last":0.46899999999999997},{"interface":"front","average":{"1min":0.47699999999999998,"5min":0.47699999999999998,"15min":0.47699999999999998},"min":{"1min":0.32300000000000001,"5min":0.32300000000000001,"15min":0.32300000000000001},"max":{"1min":0.86199999999999999,"5min":0.86199999999999999,"15min":0.86199999999999999},"last":0.501}]},{"osd":7,"last update":"Sat May 25 05:13:24 2024","interfaces":[{"interface":"back","average":{"1min":0.51600000000000001,"5min":0.51600000000000001,"15min":0.51600000000000001},"min":{"1min":0.36799999999999999,"5min":0.36799999999999999,"15min":0.36799999999999999},"max":{"1min":0.69699999999999995,"5min":0.69699999999999995,"15min":0.69699999999999995},"last":0.45500000000000002},{"interface":"front","average":{"1min":0.51200000000000001,"5min":0.51200000000000001,"15min":0.51200000000000001},"min":{"1min":0.32700000000000001,"5min":0.32700000000000001,"15min":0.32700000000000001},"max":{"1min":0.72399999999999998,"5min":0.72399999999999998,"15min":0.72399999999999998},"last":0.40400000000000003}]}]}],"pool_statfs":[{"poolid":1,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":6,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":7,"total":0,"available":0,"internally_reserved":0,"allocated":532480,"data_stored":528928,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-05-25T05:14:08.868 INFO:tasks.cephadm.ceph_manager.ceph:clean! 2024-05-25T05:14:08.869 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-05-25T05:14:08.869 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy 2024-05-25T05:14:08.869 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -- ceph health --format=json 2024-05-25T05:14:09.599 INFO:teuthology.orchestra.run.smithi088.stderr:Inferring config /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/mon.a/config 2024-05-25T05:14:09.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:09 smithi136 ceph-mon[25618]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:09.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:09 smithi088 ceph-mon[24736]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:09.790 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:09 smithi088 ceph-mon[29649]: pgmap v47: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:11.486 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:14:11.487 INFO:teuthology.orchestra.run.smithi088.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-05-25T05:14:11.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:11 smithi136 ceph-mon[25618]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:11.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:11 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3828661968' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-25T05:14:11.794 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:11 smithi088 ceph-mon[24736]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:11.794 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:11 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3828661968' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-25T05:14:11.795 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:11 smithi088 ceph-mon[29649]: pgmap v48: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:11.795 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:11 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3828661968' entity='client.admin' cmd=[{"prefix": "health", "format": "json"}]: dispatch 2024-05-25T05:14:12.178 INFO:tasks.cephadm.ceph_manager.ceph:wait_until_healthy done 2024-05-25T05:14:12.178 INFO:tasks.cephadm:Setup complete, yielding 2024-05-25T05:14:12.178 INFO:teuthology.run_tasks:Running task cephadm.shell... 2024-05-25T05:14:12.189 INFO:tasks.cephadm:Running commands on role mon.a host ubuntu@smithi088.front.sepia.ceph.com 2024-05-25T05:14:12.189 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'radosgw-admin realm create --rgw-realm=r --default' 2024-05-25T05:14:13.076 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 podman[43945]: 2024-05-25 05:14:12.956891405 +0000 UTC m=+0.018870628 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-05-25T05:14:13.076 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 podman[43945]: 2024-05-25 05:14:13.076980859 +0000 UTC m=+0.138960097 container create e07f64cf0d7b05e876c871dc176637789b0a125fb6592c827ec2e6ab9f040a76 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., release=236.1648460182, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.buildah.version=1.24.2, io.openshift.tags=base rhel8, version=8.5, maintainer=Paul Cuzner , vcs-type=git, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Grafana Container configured for Ceph mgr/dashboard integration, architecture=x86_64, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.component=ubi8-container, distribution-scope=public, name=ubi8, io.k8s.display-name=Red Hat Universal Base Image 8) 2024-05-25T05:14:13.326 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 podman[43945]: 2024-05-25 05:14:13.262719282 +0000 UTC m=+0.324698507 container init e07f64cf0d7b05e876c871dc176637789b0a125fb6592c827ec2e6ab9f040a76 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Paul Cuzner , io.openshift.expose-services=, description=Ceph Grafana Container, name=ubi8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, build-date=2022-03-28T10:36:18.413762, vendor=Red Hat, Inc., architecture=x86_64, release=236.1648460182, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, io.buildah.version=1.24.2, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, version=8.5, com.redhat.component=ubi8-container, io.openshift.tags=base rhel8) 2024-05-25T05:14:13.327 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 podman[43945]: 2024-05-25 05:14:13.265816284 +0000 UTC m=+0.327795494 container start e07f64cf0d7b05e876c871dc176637789b0a125fb6592c827ec2e6ab9f040a76 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, vcs-type=git, description=Ceph Grafana Container, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, name=ubi8, vendor=Red Hat, Inc., architecture=x86_64, version=8.5, build-date=2022-03-28T10:36:18.413762, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.component=ubi8-container, distribution-scope=public, release=236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.24.2, io.openshift.tags=base rhel8) 2024-05-25T05:14:13.327 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-05-25T05:14:13.327 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-05-25T05:14:13.327 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-05-25T05:14:13.327 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-05-25T05:14:13.327 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="App mode production" logger=settings 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-05-25T05:14:13.328 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create migration_log table" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create user table" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.login" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user.email" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_login - v1" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_user_email - v1" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table user to user_v1 - v1" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create user table v2" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_login - v2" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_user_email - v2" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table user_v1" 2024-05-25T05:14:13.329 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column help_flags1 to user table" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update user table charset" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add last_seen_at column to user" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add missing user data" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_disabled column to user" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index user.login/user.email" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add is_service_account column to user" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create temp user table v1-7" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v1-7" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v1-7" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v1-7" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v1-7" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update temp_user table charset" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_email - v1" 2024-05-25T05:14:13.330 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_org_id - v1" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_code - v1" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_temp_user_status - v1" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table temp_user to temp_user_tmp_qwerty - v1" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create temp_user v2" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_email - v2" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_org_id - v2" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_code - v2" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_temp_user_status - v2" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy temp_user v1 to v2" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop temp_user_tmp_qwerty" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Set created for temp users that will otherwise prematurely expire" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create star table" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index star.user_id_dashboard_id" 2024-05-25T05:14:13.331 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create org table v1" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_name - v1" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create org_user table v1" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_org_id - v1" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_org_user_org_id_user_id - v1" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_org_user_user_id - v1" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update org table charset" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update org_user table charset" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate all Read Only Viewers to Viewers" 2024-05-25T05:14:13.332 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard table" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard.account_id" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_account_id_slug" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_tag table" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_tag.dasboard_id_term" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_dashboard_tag_dashboard_id_term - v1" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard to dashboard_v1 - v1" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard v2" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_org_id - v2" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_org_id_slug - v2" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard v1 to v2" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_v1" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard.data to mediumtext v1" 2024-05-25T05:14:13.333 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column updated_by in dashboard - v2" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column created_by in dashboard - v2" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column gnetId in dashboard" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for gnetId in dashboard" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_id in dashboard" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for plugin_id in dashboard" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_id in dashboard_tag" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard table charset" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_tag table charset" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column folder_id in dashboard" 2024-05-25T05:14:13.334 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column isFolder in dashboard" 2024-05-25T05:14:13.577 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:13 smithi136 ceph-mon[25618]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:13.577 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:13 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:13.577 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:13 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:13.577 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:13 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:13.577 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:13 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:13.578 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:13 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:13.578 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column has_acl in dashboard" 2024-05-25T05:14:13.578 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in dashboard" 2024-05-25T05:14:13.578 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in dashboard" 2024-05-25T05:14:13.578 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index dashboard_org_id_uid" 2024-05-25T05:14:13.578 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_slug" 2024-05-25T05:14:13.579 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard title length" 2024-05-25T05:14:13.579 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index for dashboard_org_id_title_folder_id" 2024-05-25T05:14:13.579 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning" 2024-05-25T05:14:13.579 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table dashboard_provisioning to dashboard_provisioning_tmp_qwerty - v1" 2024-05-25T05:14:13.579 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_provisioning v2" 2024-05-25T05:14:13.579 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id - v2" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_provisioning_dashboard_id_name - v2" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy dashboard_provisioning v1 to v2" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop dashboard_provisioning_tmp_qwerty" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add check_sum column" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_title" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="delete tags for deleted dashboards" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="delete stars for deleted dashboards" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 bash[43945]: e07f64cf0d7b05e876c871dc176637789b0a125fb6592c827ec2e6ab9f040a76 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for dashboard_is_folder" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table" 2024-05-25T05:14:13.580 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 systemd[1]: Started Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index data_source.account_id" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index data_source.account_id_name" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_data_source_account_id - v1" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_data_source_account_id_name - v1" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table data_source to data_source_v1 - v1" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create data_source table v2" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_data_source_org_id - v2" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_data_source_org_id_name - v2" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy data_source v1 to v2" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table data_source_v1 #2" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column with_credentials" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add secure json data column" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update data_source table charset" 2024-05-25T05:14:13.581 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update initial version to 1" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add read_only data column" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Migrate logging ds to loki ds" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update json_data with nulls" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add uid column" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid value" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index datasource_org_id_uid" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index datasource_org_id_is_default" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.key" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index api_key.account_id_name" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_api_key_account_id - v1" 2024-05-25T05:14:13.582 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_key - v1" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_api_key_account_id_name - v1" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table api_key to api_key_v1 - v1" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create api_key table v2" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_api_key_org_id - v2" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_key - v2" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_api_key_org_id_name - v2" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy api_key v1 to v2" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table api_key_v1" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update api_key table charset" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add expires to api_key table" 2024-05-25T05:14:13.583 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add service account foreign key" 2024-05-25T05:14:13.584 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v4" 2024-05-25T05:14:13.585 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop table dashboard_snapshot_v4 #1" 2024-05-25T05:14:13.585 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_snapshot table v5 #2" 2024-05-25T05:14:13.585 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_key - v5" 2024-05-25T05:14:13.585 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_dashboard_snapshot_delete_key - v5" 2024-05-25T05:14:13.585 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_dashboard_snapshot_user_id - v5" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_snapshot to mediumtext v2" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update dashboard_snapshot table charset" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external_delete_url to dashboard_snapshots table" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add encrypted dashboard json column" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Change dashboard_encrypted column to MEDIUMBLOB" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create quota table v1" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_quota_org_id_user_id_target - v1" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update quota table charset" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create plugin_setting table" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_plugin_setting_org_id_plugin_id - v1" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column plugin_version to plugin_settings" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update plugin_setting table charset" 2024-05-25T05:14:13.586 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create session table" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist table" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old table playlist_item table" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist table v2" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create playlist item table v2" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist table charset" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update playlist_item table charset" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v2" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop preferences table v3" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create preferences table v3" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update preferences table charset" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column team_id in preferences" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update team_id column values in preferences" 2024-05-25T05:14:13.587 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column week_start in preferences" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create alert table v1" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert org_id & id " 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert state" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert dashboard_id" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v1" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_rule_tag.alert_id_tag_id" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_alert_rule_tag_alert_id_tag_id - v1" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table alert_rule_tag to alert_rule_tag_v1 - v1" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Create alert_rule_tag table v2" 2024-05-25T05:14:13.588 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_alert_rule_tag_alert_id_tag_id - Add unique index alert_rule_tag.alert_id_tag_id V2" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy alert_rule_tag v1 to v2" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop table alert_rule_tag_v1" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification table v1" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column is_default" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column frequency" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column send_reminder" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column disable_resolve_message" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification org_id & name" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert table charset" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert_notification table charset" 2024-05-25T05:14:13.589 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create notification_journal table v1" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index notification_journal org_id & alert_id & notifier_id" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_notification_journal" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_notification_state table v1" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index alert_notification_state org_id & alert_id & notifier_id" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add for to alert table" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column uid in alert_notification" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update uid column values in alert_notification" 2024-05-25T05:14:13.590 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index alert_notification_org_id_uid" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index org_id_name" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column secure_settings in alert_notification" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert.settings to mediumtext" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_notification_state_alert_id" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add non-unique index alert_rule_tag_alert_id" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop old annotation table v4" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create annotation table v5" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 0 v3" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 1 v3" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 2 v3" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 3 v3" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index annotation 4 v3" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update annotation table charset" 2024-05-25T05:14:13.591 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column region_id to annotation table" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Drop category_id index" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column tags to annotation table" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v2" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add unique index annotation_tag.annotation_id_tag_id" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index UQE_annotation_tag_annotation_id_tag_id - v2" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table annotation_tag to annotation_tag_v2 - v2" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Create annotation_tag table v3" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index UQE_annotation_tag_annotation_id_tag_id - Add unique index annotation_tag.annotation_id_tag_id V3" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy annotation_tag v2 to v3" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop table annotation_tag_v2" 2024-05-25T05:14:13.592 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Update alert annotations and set TEXT to empty" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add created time to annotation table" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add updated time to annotation table" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for created in annotation table" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for updated in annotation table" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Convert existing annotations from seconds to milliseconds" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add epoch_end column" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for epoch_end" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Make epoch_end the same as epoch" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Move region to single row" 2024-05-25T05:14:13.593 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch from annotation table" 2024-05-25T05:14:13.594 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_dashboard_id_panel_id_epoch from annotation table" 2024-05-25T05:14:13.594 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_dashboard_id_epoch_end_epoch on annotation table" 2024-05-25T05:14:13.594 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for org_id_epoch_end_epoch on annotation table" 2024-05-25T05:14:13.594 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Remove index org_id_epoch_epoch_end from annotation table" 2024-05-25T05:14:13.594 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index for alert_id on annotation table" 2024-05-25T05:14:13.594 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create test_data table" 2024-05-25T05:14:13.595 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard_version table v1" 2024-05-25T05:14:13.595 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_version.dashboard_id" 2024-05-25T05:14:13.595 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_version.dashboard_id and dashboard_version.version" 2024-05-25T05:14:13.595 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Set dashboard version to 1 where 0" 2024-05-25T05:14:13.595 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="save existing dashboard data in dashboard_version table v1" 2024-05-25T05:14:13.595 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter dashboard_version.data to mediumtext v1" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create team table" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index team.org_id" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_org_id_name" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create team member table" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.org_id" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_member_org_id_team_id_user_id" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_member.team_id" 2024-05-25T05:14:13.596 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column email to team table" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column external to team_member table" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column permission to team_member table" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create dashboard acl table" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_dashboard_id" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_user_id" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index dashboard_acl_dashboard_id_team_id" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_user_id" 2024-05-25T05:14:13.597 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_team_id" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_acl_org_id_role" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index dashboard_permission" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="save default acl rules in dashboard_acl table" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="delete acl rules for deleted dashboards and folders" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create tag table" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index tag.key_value" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create login attempt table" 2024-05-25T05:14:13.598 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index login_attempt.username" 2024-05-25T05:14:13.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index IDX_login_attempt_username - v1" 2024-05-25T05:14:13.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Rename table login_attempt to login_attempt_tmp_qwerty - v1" 2024-05-25T05:14:13.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create login_attempt v2" 2024-05-25T05:14:13.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_login_attempt_username - v2" 2024-05-25T05:14:13.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="copy login_attempt v1 to v2" 2024-05-25T05:14:13.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop login_attempt_tmp_qwerty" 2024-05-25T05:14:13.599 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth table" 2024-05-25T05:14:13.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[24736]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:13.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[29649]: pgmap v49: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:13.728 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:13 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create index IDX_user_auth_auth_module_auth_id - v1" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter user_auth.auth_id to length 190" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth access token to user_auth" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth refresh token to user_auth" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth token type to user_auth" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add OAuth expiry to user_auth" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add index to user_id column in user_auth" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create server_lock table" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index server_lock.operation_uid" 2024-05-25T05:14:13.838 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create user auth token table" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.auth_token" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_auth_token.prev_auth_token" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_auth_token.user_id" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add revoked_at to the user auth token" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create cache_data table" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index cache_data.cache_key" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create short_url table v1" 2024-05-25T05:14:13.839 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index short_url.org_id-uid" 2024-05-25T05:14:13.840 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition table" 2024-05-25T05:14:13.840 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition table" 2024-05-25T05:14:13.841 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and title columns" 2024-05-25T05:14:13.841 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition on org_id and uid columns" 2024-05-25T05:14:13.841 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition table data column to mediumtext in mysql" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and title columns" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop index in alert_definition on org_id and uid columns" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and title columns" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index in alert_definition on org_id and uid columns" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column paused in alert_definition" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition table" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="delete alert_definition_version table" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="recreate alert_definition_version table" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_id and version columns" 2024-05-25T05:14:13.842 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_definition_version table on alert_definition_uid and version columns" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_definition_version table data column to mediumtext in mysql" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="drop alert_definition_version table" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_instance table" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, def_uid and current_state columns" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_instance table on def_org_id, current_state columns" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column current_state_end to alert_instance" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, def_uid, current_state on alert_instance" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="remove index def_org_id, current_state on alert_instance" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_org_id to rule_org_id in alert_instance" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="rename def_uid to rule_uid in alert_instance" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, rule_uid, current_state on alert_instance" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index rule_org_id, current_state on alert_instance" 2024-05-25T05:14:13.843 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule table" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and title columns" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id and uid columns" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespace_uid, group_uid columns" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule table data column to mediumtext in mysql" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="remove unique index from alert_rule on org_id, title columns" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, namespase_uid and title columns" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add dashboard_uid column to alert_rule" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add panel_id column to alert_rule" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule on org_id, dashboard_uid and panel_id columns" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create alert_rule_version table" 2024-05-25T05:14:13.844 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_uid and version columns" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_rule_version table on rule_org_id, rule_namespace_uid and rule_group columns" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alter alert_rule_version table data column to mediumtext in mysql" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column for to alert_rule_version" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column annotations to alert_rule_version" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column labels to alert_rule_version" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id=create_alert_configuration_table 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column default in alert_configuration" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="alert alert_configuration alertmanager_configuration column from TEXT to MEDIUMTEXT if mysql" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column org_id in alert_configuration" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in alert_configuration table on org_id column" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id=create_ngalert_configuration_table 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index in ngalert_configuration on org_id column" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="clear migration entry \"remove unified alerting data\"" 2024-05-25T05:14:13.845 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="move dashboard alerts to unified alerting" 2024-05-25T05:14:13.846 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element table v1" 2024-05-25T05:14:13.846 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element org_id-folder_id-name-kind" 2024-05-25T05:14:13.846 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create library_element_connection table v1" 2024-05-25T05:14:13.846 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index library_element_connection element_id-kind-connection_id" 2024-05-25T05:14:13.846 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index library_element org_id_uid" 2024-05-25T05:14:13.846 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="clone move dashboard alerts to unified alerting" 2024-05-25T05:14:13.849 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create data_keys table" 2024-05-25T05:14:13.849 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create kv_store table v1" 2024-05-25T05:14:13.849 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index kv_store.org_id-namespace-key" 2024-05-25T05:14:13.849 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="update dashboard_uid and panel_id from existing annotations" 2024-05-25T05:14:13.849 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create permission table" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index permission.role_id" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_id_action_scope" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create role table" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column display_name" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add column group_name" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index role.org_id" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role_org_id_name" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index role_org_id_uid" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create team role table" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.org_id" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index team_role_org_id_team_id_role_id" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index team_role.team_id" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create user role table" 2024-05-25T05:14:13.850 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.org_id" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index user_role_org_id_user_id_role_id" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index user_role.user_id" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create builtin role table" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.role_id" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.name" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Add column org_id to builtin_role table" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add index builtin_role.org_id" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_org_id_role_id_role" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="Remove unique index role_org_id_uid" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index role.uid" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="create seed assignment table" 2024-05-25T05:14:13.851 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Executing migration" logger=migrator id="add unique index builtin_role_role_name" 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="migrations completed" logger=migrator performed=381 skipped=0 duration=426.361923ms 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=warn msg="[Deprecated] the datasource provisioning config is outdated. please upgrade" logger=provisioning.datasources filename=/etc/grafana/provisioning/datasources/ceph-dashboard.yml 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-05-25T05:14:13.852 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-05-25T05:14:14.134 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-05-25T05:14:14.134 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:14:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:14:13+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-05-25T05:14:14.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:14.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:14 smithi088 ceph-mon[24736]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-25T05:14:14.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:14 smithi088 ceph-mon[24736]: Reconfiguring daemon alertmanager.a on smithi088 2024-05-25T05:14:14.643 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:14.643 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:14 smithi088 ceph-mon[29649]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-25T05:14:14.643 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:14 smithi088 ceph-mon[29649]: Reconfiguring daemon alertmanager.a on smithi088 2024-05-25T05:14:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:14 smithi136 ceph-mon[25618]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-25T05:14:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:14 smithi136 ceph-mon[25618]: Reconfiguring daemon alertmanager.a on smithi088 2024-05-25T05:14:15.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:15 smithi136 ceph-mon[25618]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:15.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:15 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:15.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:15 smithi088 ceph-mon[29649]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:15 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:15.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:15 smithi088 ceph-mon[24736]: pgmap v50: 1 pgs: 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:15.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:15 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:16.496 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:16] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:16.607 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:14:16.607 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "ab5e4940-1f1d-460c-b9a5-42b3b66b2f0a", 2024-05-25T05:14:16.607 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "r", 2024-05-25T05:14:16.607 INFO:teuthology.orchestra.run.smithi088.stdout: "current_period": "b07a0b43-cbb1-4458-acd3-bdbc706b899d", 2024-05-25T05:14:16.607 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1 2024-05-25T05:14:16.607 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:14:16.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:16 smithi136 ceph-mon[25618]: osdmap e61: 8 total, 8 up, 8 in 2024-05-25T05:14:16.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:16 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/95171669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-25T05:14:16.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:16 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:16.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:16 smithi088 ceph-mon[24736]: osdmap e61: 8 total, 8 up, 8 in 2024-05-25T05:14:16.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:16 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/95171669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-25T05:14:16.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:16 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:16.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:16 smithi088 ceph-mon[29649]: osdmap e61: 8 total, 8 up, 8 in 2024-05-25T05:14:16.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:16 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/95171669' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]: dispatch 2024-05-25T05:14:16.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:16 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:17.706 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'radosgw-admin zonegroup create --rgw-zonegroup=default --master --default' 2024-05-25T05:14:17.822 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:17 smithi136 ceph-mon[25618]: pgmap v52: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:17.823 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:17 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/95171669' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-25T05:14:17.823 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:17 smithi136 ceph-mon[25618]: osdmap e62: 8 total, 8 up, 8 in 2024-05-25T05:14:17.880 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:17 smithi088 ceph-mon[24736]: pgmap v52: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:17.880 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:17 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/95171669' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-25T05:14:17.880 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:17 smithi088 ceph-mon[24736]: osdmap e62: 8 total, 8 up, 8 in 2024-05-25T05:14:17.880 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:17 smithi088 ceph-mon[29649]: pgmap v52: 33 pgs: 32 unknown, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:17.880 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:17 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/95171669' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": ".rgw.root","app": "rgw"}]': finished 2024-05-25T05:14:17.880 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:17 smithi088 ceph-mon[29649]: osdmap e62: 8 total, 8 up, 8 in 2024-05-25T05:14:18.883 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:18 smithi088 ceph-mon[24736]: osdmap e63: 8 total, 8 up, 8 in 2024-05-25T05:14:18.883 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:18 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:18] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:18.884 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:18 smithi088 ceph-mon[29649]: osdmap e63: 8 total, 8 up, 8 in 2024-05-25T05:14:18.884 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:18 smithi088 systemd[1]: Stopping Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:14:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:18 smithi136 ceph-mon[25618]: osdmap e63: 8 total, 8 up, 8 in 2024-05-25T05:14:19.164 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:19 smithi088 bash[50855]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager.a" found: no such container 2024-05-25T05:14:19.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:19 smithi088 ceph-mon[29649]: pgmap v55: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:19.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:19 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:19 smithi088 ceph-mon[24736]: pgmap v55: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:19.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:19 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:19 smithi136 ceph-mon[25618]: pgmap v55: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:19 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "289a3b97-84d3-4f69-bb0b-6bc5ccc97f7f", 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "default", 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "api_name": "default", 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "is_master": "true", 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "endpoints": [], 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "hostnames": [], 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "hostnames_s3website": [], 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "master_zone": "", 2024-05-25T05:14:20.379 INFO:teuthology.orchestra.run.smithi088.stdout: "zones": [], 2024-05-25T05:14:20.380 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_targets": [], 2024-05-25T05:14:20.380 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "", 2024-05-25T05:14:20.380 INFO:teuthology.orchestra.run.smithi088.stdout: "realm_id": "ab5e4940-1f1d-460c-b9a5-42b3b66b2f0a", 2024-05-25T05:14:20.380 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_policy": { 2024-05-25T05:14:20.380 INFO:teuthology.orchestra.run.smithi088.stdout: "groups": [] 2024-05-25T05:14:20.380 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:20.380 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:14:20.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:20.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:20] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:21.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:20 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[49224]: level=info ts=2024-05-25T05:14:20.652Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:14:21.058 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:20 smithi088 podman[50873]: 2024-05-25 05:14:20.672467471 +0000 UTC m=+1.605118182 container died 43b810a77ed38d797ec84cd286dff89315acd69244b49d53cbddc3112521a443 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:21.435 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[29649]: pgmap v56: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:21.436 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.436 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.436 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.436 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[24736]: pgmap v56: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:21.436 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.436 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.436 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:21 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.436 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 podman[50873]: 2024-05-25 05:14:21.151545849 +0000 UTC m=+2.084196555 container cleanup 43b810a77ed38d797ec84cd286dff89315acd69244b49d53cbddc3112521a443 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:21.437 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 bash[50873]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a 2024-05-25T05:14:21.437 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 bash[51028]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager.a" found: no such container 2024-05-25T05:14:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:21 smithi136 ceph-mon[25618]: pgmap v56: 33 pgs: 32 creating+peering, 1 active+clean; 577 KiB data, 48 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:21.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:21 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:21 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:21 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:21.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 podman[51014]: 2024-05-25 05:14:21.436304801 +0000 UTC m=+0.763748055 container remove 43b810a77ed38d797ec84cd286dff89315acd69244b49d53cbddc3112521a443 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:21.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 podman[51014]: 2024-05-25 05:14:21.528758961 +0000 UTC m=+0.856202217 volume remove a1e2c9be943094a5ce91fcf5d6a5b39b5aa6e112f84eb67f04884fbe806bd905 2024-05-25T05:14:21.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-25T05:14:21.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 systemd[1]: Stopped Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:14:21.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:21 smithi088 systemd[1]: Starting Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:14:21.891 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'radosgw-admin zone create --rgw-zonegroup=default --rgw-zone=z --master --default' 2024-05-25T05:14:22.191 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 podman[51117]: 2024-05-25 05:14:22.090890069 +0000 UTC m=+0.102315710 volume create d95d9579604bffffe4bec37c5c1db8f645cb0017b77056d814381ecb1f1afaab 2024-05-25T05:14:22.191 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 podman[51117]: 2024-05-25 05:14:22.006078342 +0000 UTC m=+0.017503998 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-05-25T05:14:22.191 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 podman[51117]: 2024-05-25 05:14:22.191469209 +0000 UTC m=+0.202894869 container create e7567de1f5841269589eedd99bafdc2a21cb57f83f6c2b046ee0d1a10118ea26 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:22.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 podman[51117]: 2024-05-25 05:14:22.536162637 +0000 UTC m=+0.547588284 container init e7567de1f5841269589eedd99bafdc2a21cb57f83f6c2b046ee0d1a10118ea26 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:22.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 podman[51117]: 2024-05-25 05:14:22.539544487 +0000 UTC m=+0.550970132 container start e7567de1f5841269589eedd99bafdc2a21cb57f83f6c2b046ee0d1a10118ea26 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:22.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.552Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-05-25T05:14:22.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.552Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-05-25T05:14:22.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.554Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.88 port=9094 2024-05-25T05:14:22.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.555Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-25T05:14:22.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.580Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:14:22.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.580Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:14:22.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.582Z caller=main.go:518 msg=Listening address=:9093 2024-05-25T05:14:22.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:22.582Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-05-25T05:14:22.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 bash[51117]: e7567de1f5841269589eedd99bafdc2a21cb57f83f6c2b046ee0d1a10118ea26 2024-05-25T05:14:22.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:22 smithi088 systemd[1]: Started Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:14:23.677 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[29649]: pgmap v57: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-25T05:14:23.677 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:23.678 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[29649]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:14:23.678 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[29649]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:14:23.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[24736]: pgmap v57: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-25T05:14:23.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:23.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[24736]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:14:23.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:23 smithi088 ceph-mon[24736]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:14:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:23 smithi136 ceph-mon[25618]: pgmap v57: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 625 B/s rd, 1.7 KiB/s wr, 2 op/s 2024-05-25T05:14:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:23 smithi136 ceph-mon[25618]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:14:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:23 smithi136 ceph-mon[25618]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:14:24.761 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:24.555Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000184394s 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "08b447b0-6711-4892-b850-14c80bcb51fd", 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "z", 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout: "domain_root": "z.rgw.meta:root", 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout: "control_pool": "z.rgw.control", 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout: "gc_pool": "z.rgw.log:gc", 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout: "lc_pool": "z.rgw.log:lc", 2024-05-25T05:14:25.178 INFO:teuthology.orchestra.run.smithi088.stdout: "log_pool": "z.rgw.log", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "intent_log_pool": "z.rgw.log:intent", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "usage_log_pool": "z.rgw.log:usage", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "roles_pool": "z.rgw.meta:roles", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "reshard_pool": "z.rgw.log:reshard", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "user_keys_pool": "z.rgw.meta:users.keys", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "user_email_pool": "z.rgw.meta:users.email", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "user_swift_pool": "z.rgw.meta:users.swift", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "user_uid_pool": "z.rgw.meta:users.uid", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "otp_pool": "z.rgw.otp", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "system_key": { 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "access_key": "", 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: "secret_key": "" 2024-05-25T05:14:25.179 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_pools": [ 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "default-placement", 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "val": { 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "index_pool": "z.rgw.buckets.index", 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "storage_classes": { 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "STANDARD": { 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "data_pool": "z.rgw.buckets.data" 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "data_extra_pool": "z.rgw.buckets.non-ec", 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: "index_type": 0 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:25.180 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:14:25.181 INFO:teuthology.orchestra.run.smithi088.stdout: "realm_id": "ab5e4940-1f1d-460c-b9a5-42b3b66b2f0a", 2024-05-25T05:14:25.181 INFO:teuthology.orchestra.run.smithi088.stdout: "notif_pool": "z.rgw.log:notif" 2024-05-25T05:14:25.181 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:14:25.663 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:14:25] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:25.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:25 smithi136 ceph-mon[25618]: pgmap v58: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-05-25T05:14:25.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:25 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:25.682 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:25 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:25.682 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:14:25.682 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 bash[44843]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:14:25.682 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.672Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.673Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.673Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[41546]: ts=2024-05-25T05:14:25.673Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-25T05:14:25.683 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:25 smithi136 podman[44854]: 2024-05-25 05:14:25.682991958 +0000 UTC m=+0.115427877 container died 3ff1574868ee3bcb24682c6e215762dd7367c3457b8813b7c5963321c758dc42 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:25.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'radosgw-admin period update --rgw-realm=r --commit' 2024-05-25T05:14:26.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:25 smithi088 ceph-mon[24736]: pgmap v58: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-05-25T05:14:26.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:25 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:25 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:25 smithi088 ceph-mon[29649]: pgmap v58: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-05-25T05:14:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:25 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:25 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:26.315 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 podman[44854]: 2024-05-25 05:14:26.056051184 +0000 UTC m=+0.488487095 container cleanup 3ff1574868ee3bcb24682c6e215762dd7367c3457b8813b7c5963321c758dc42 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:26.315 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 bash[44854]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:14:26.315 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 bash[44882]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:14:26.612 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 podman[44867]: 2024-05-25 05:14:26.315784966 +0000 UTC m=+0.630978435 container remove 3ff1574868ee3bcb24682c6e215762dd7367c3457b8813b7c5963321c758dc42 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:26.612 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-25T05:14:26.612 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 systemd[1]: Stopped Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:14:26.612 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 systemd[1]: Starting Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:14:26.612 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 podman[44944]: 2024-05-25 05:14:26.53358627 +0000 UTC m=+0.106519605 container create 3ab94cbffc5c5c4b4fc9b5b996165edc18be833bee331078521f1f53aab82d89 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:26.612 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 podman[44944]: 2024-05-25 05:14:26.445186921 +0000 UTC m=+0.018120248 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 podman[44944]: 2024-05-25 05:14:26.702420655 +0000 UTC m=+0.275353968 container init 3ab94cbffc5c5c4b4fc9b5b996165edc18be833bee331078521f1f53aab82d89 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 podman[44944]: 2024-05-25 05:14:26.705270397 +0000 UTC m=+0.278203713 container start 3ab94cbffc5c5c4b4fc9b5b996165edc18be833bee331078521f1f53aab82d89 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.728Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.728Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.728Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.728Z caller=main.go:518 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.728Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.728Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.729Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:14:27.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.730Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.730Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.733Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.733Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.809µs 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.733Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.734Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=1 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.734Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=1 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.734Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=24.216µs wal_replay_duration=1.466967ms total_replay_duration=1.506349ms 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.735Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.735Z caller=main.go:947 level=info msg="TSDB started" 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.735Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.749Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=13.309032ms db_storage=608ns remote_storage=1.185µs web_handler=355ns query_engine=529ns scrape=348.997µs scrape_sd=21.757µs notify=18.156µs notify_sd=5.882µs rules=12.700202ms 2024-05-25T05:14:27.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:14:26.749Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-25T05:14:27.137 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 bash[44944]: 3ab94cbffc5c5c4b4fc9b5b996165edc18be833bee331078521f1f53aab82d89 2024-05-25T05:14:27.137 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:14:26 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: pgmap v59: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 536 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.88:9093"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.88:9093"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:14:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.136:3000"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.136:3000"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: pgmap v59: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 536 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-05-25T05:14:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.88:9093"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.88:9093"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.136:3000"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.136:3000"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:28.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:28.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:28.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:28.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:28.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:28.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:27 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: pgmap v59: 33 pgs: 33 active+clean; 578 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 536 B/s rd, 1.4 KiB/s wr, 2 op/s 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.88:9093"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://172.21.15.88:9093"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.136:3000"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://172.21.15.136:3000"}]: dispatch 2024-05-25T05:14:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:28.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:27 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:29.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:28 smithi136 ceph-mon[25618]: osdmap e64: 8 total, 8 up, 8 in 2024-05-25T05:14:29.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:28 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2159901321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-25T05:14:29.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:28 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-25T05:14:29.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:28 smithi088 ceph-mon[29649]: osdmap e64: 8 total, 8 up, 8 in 2024-05-25T05:14:29.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:28 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2159901321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-25T05:14:29.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:28 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-25T05:14:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:28 smithi088 ceph-mon[24736]: osdmap e64: 8 total, 8 up, 8 in 2024-05-25T05:14:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:28 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2159901321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-25T05:14:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:28 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]: dispatch 2024-05-25T05:14:30.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:29 smithi088 ceph-mon[24736]: pgmap v61: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-05-25T05:14:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:29 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-05-25T05:14:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:29 smithi088 ceph-mon[24736]: osdmap e65: 8 total, 8 up, 8 in 2024-05-25T05:14:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:29 smithi088 ceph-mon[29649]: pgmap v61: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-05-25T05:14:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:29 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-05-25T05:14:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:29 smithi088 ceph-mon[29649]: osdmap e65: 8 total, 8 up, 8 in 2024-05-25T05:14:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:29 smithi136 ceph-mon[25618]: pgmap v61: 65 pgs: 32 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 716 B/s rd, 1.6 KiB/s wr, 2 op/s 2024-05-25T05:14:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:29 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.log","app": "rgw"}]': finished 2024-05-25T05:14:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:29 smithi136 ceph-mon[25618]: osdmap e65: 8 total, 8 up, 8 in 2024-05-25T05:14:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:30 smithi136 ceph-mon[25618]: osdmap e66: 8 total, 8 up, 8 in 2024-05-25T05:14:31.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:30 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2159901321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-25T05:14:31.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:30 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-25T05:14:31.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:30 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-05-25T05:14:31.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:30 smithi136 ceph-mon[25618]: osdmap e67: 8 total, 8 up, 8 in 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[29649]: osdmap e66: 8 total, 8 up, 8 in 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2159901321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[29649]: osdmap e67: 8 total, 8 up, 8 in 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[24736]: osdmap e66: 8 total, 8 up, 8 in 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2159901321' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]: dispatch 2024-05-25T05:14:31.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.control","app": "rgw"}]': finished 2024-05-25T05:14:31.200 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:30 smithi088 ceph-mon[24736]: osdmap e67: 8 total, 8 up, 8 in 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[29649]: pgmap v64: 97 pgs: 64 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 853 B/s wr, 1 op/s 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[29649]: osdmap e68: 8 total, 8 up, 8 in 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[24736]: pgmap v64: 97 pgs: 64 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 853 B/s wr, 1 op/s 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[24736]: osdmap e68: 8 total, 8 up, 8 in 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-25T05:14:31.902 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:31 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-25T05:14:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:31 smithi136 ceph-mon[25618]: pgmap v64: 97 pgs: 64 unknown, 33 active+clean; 579 KiB data, 49 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 853 B/s wr, 1 op/s 2024-05-25T05:14:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:31 smithi136 ceph-mon[25618]: osdmap e68: 8 total, 8 up, 8 in 2024-05-25T05:14:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:31 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-25T05:14:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:31 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]: dispatch 2024-05-25T05:14:32.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:14:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:14:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:14:32.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:32 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:14:32] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:32.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:14:32 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:14:32.556Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.001559695s 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[24736]: pgmap v67: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[24736]: osdmap e69: 8 total, 8 up, 8 in 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-25T05:14:33.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[29649]: pgmap v67: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-25T05:14:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-05-25T05:14:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[29649]: osdmap e69: 8 total, 8 up, 8 in 2024-05-25T05:14:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-25T05:14:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:33 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-25T05:14:33.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:33 smithi136 ceph-mon[25618]: pgmap v67: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-25T05:14:33.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:33 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:33.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:33 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:33.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:33 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "z.rgw.meta","app": "rgw"}]': finished 2024-05-25T05:14:33.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:33 smithi136 ceph-mon[25618]: osdmap e69: 8 total, 8 up, 8 in 2024-05-25T05:14:33.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:33 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-25T05:14:33.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:33 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]: dispatch 2024-05-25T05:14:34.931 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:14:34.931 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "3c8e88b9-4e06-4ea8-bc29-f16ef419df04", 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "epoch": 1, 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "predecessor_uuid": "b07a0b43-cbb1-4458-acd3-bdbc706b899d", 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_status": [], 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "period_map": { 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "3c8e88b9-4e06-4ea8-bc29-f16ef419df04", 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "zonegroups": [ 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "289a3b97-84d3-4f69-bb0b-6bc5ccc97f7f", 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "default", 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "api_name": "default", 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "is_master": "true", 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "endpoints": [], 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "hostnames": [], 2024-05-25T05:14:34.932 INFO:teuthology.orchestra.run.smithi088.stdout: "hostnames_s3website": [], 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "master_zone": "08b447b0-6711-4892-b850-14c80bcb51fd", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "zones": [ 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "id": "08b447b0-6711-4892-b850-14c80bcb51fd", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "z", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "endpoints": [], 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "log_meta": "false", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "log_data": "false", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_index_max_shards": 11, 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "read_only": "false", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "tier_type": "", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_from_all": "true", 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_from": [], 2024-05-25T05:14:34.933 INFO:teuthology.orchestra.run.smithi088.stdout: "redirect_zone": "" 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "placement_targets": [ 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "name": "default-placement", 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "tags": [], 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "storage_classes": [ 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "STANDARD" 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "default_placement": "default-placement", 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "realm_id": "ab5e4940-1f1d-460c-b9a5-42b3b66b2f0a", 2024-05-25T05:14:34.934 INFO:teuthology.orchestra.run.smithi088.stdout: "sync_policy": { 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: "groups": [] 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: "short_zone_ids": [ 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: { 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: "key": "08b447b0-6711-4892-b850-14c80bcb51fd", 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: "val": 1327461650 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: ] 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: "master_zonegroup": "289a3b97-84d3-4f69-bb0b-6bc5ccc97f7f", 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: "master_zone": "08b447b0-6711-4892-b850-14c80bcb51fd", 2024-05-25T05:14:34.935 INFO:teuthology.orchestra.run.smithi088.stdout: "period_config": { 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_quota": { 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "user_quota": { 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "check_on_raw": false, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size": -1, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "max_size_kb": 0, 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: "max_objects": -1 2024-05-25T05:14:34.936 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "user_ratelimit": { 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_read_ops": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_write_ops": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_read_bytes": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_write_bytes": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "bucket_ratelimit": { 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_read_ops": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_write_ops": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_read_bytes": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "max_write_bytes": 0, 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false 2024-05-25T05:14:34.937 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "anonymous_ratelimit": { 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "max_read_ops": 0, 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "max_write_ops": 0, 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "max_read_bytes": 0, 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "max_write_bytes": 0, 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "enabled": false 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "realm_id": "ab5e4940-1f1d-460c-b9a5-42b3b66b2f0a", 2024-05-25T05:14:34.938 INFO:teuthology.orchestra.run.smithi088.stdout: "realm_name": "r", 2024-05-25T05:14:34.939 INFO:teuthology.orchestra.run.smithi088.stdout: "realm_epoch": 2 2024-05-25T05:14:34.939 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:14:35.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:34 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-25T05:14:35.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:34 smithi136 ceph-mon[25618]: osdmap e70: 8 total, 8 up, 8 in 2024-05-25T05:14:35.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:34 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-25T05:14:35.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:34 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[29649]: osdmap e70: 8 total, 8 up, 8 in 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_autoscale_bias", "val": "4"}]': finished 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[24736]: osdmap e70: 8 total, 8 up, 8 in 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1567016415' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-25T05:14:35.231 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:34 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]: dispatch 2024-05-25T05:14:35.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:14:35] "GET /metrics HTTP/1.1" 200 192927 "" "Prometheus/2.33.4" 2024-05-25T05:14:35.711 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch apply rgw foo --realm r --zone z --placement=2 --port=8000' 2024-05-25T05:14:36.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:35 smithi088 ceph-mon[29649]: pgmap v70: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-25T05:14:36.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:35 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-05-25T05:14:36.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:35 smithi088 ceph-mon[29649]: osdmap e71: 8 total, 8 up, 8 in 2024-05-25T05:14:36.009 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:35 smithi088 ceph-mon[24736]: pgmap v70: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-25T05:14:36.009 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:35 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-05-25T05:14:36.009 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:35 smithi088 ceph-mon[24736]: osdmap e71: 8 total, 8 up, 8 in 2024-05-25T05:14:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:35 smithi136 ceph-mon[25618]: pgmap v70: 129 pgs: 32 unknown, 97 active+clean; 579 KiB data, 50 MiB used, 715 GiB / 715 GiB avail; 6.0 KiB/s rd, 511 B/s wr, 7 op/s 2024-05-25T05:14:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:35 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "osd pool set", "pool": "z.rgw.meta", "var": "pg_num_min", "val": "8"}]': finished 2024-05-25T05:14:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:35 smithi136 ceph-mon[25618]: osdmap e71: 8 total, 8 up, 8 in 2024-05-25T05:14:37.530 INFO:teuthology.orchestra.run.smithi088.stdout:Scheduled rgw.foo update... 2024-05-25T05:14:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: pgmap v72: 129 pgs: 24 unknown, 105 active+clean; 581 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 481 B/s rd, 722 B/s wr, 1 op/s 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:37 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:38.255 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: pgmap v72: 129 pgs: 24 unknown, 105 active+clean; 581 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 481 B/s rd, 722 B/s wr, 1 op/s 2024-05-25T05:14:38.255 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.255 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: pgmap v72: 129 pgs: 24 unknown, 105 active+clean; 581 KiB data, 51 MiB used, 715 GiB / 715 GiB avail; 481 B/s rd, 722 B/s wr, 1 op/s 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:38.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:37 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:38.279 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph osd pool create foo' 2024-05-25T05:14:39.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:38 smithi136 ceph-mon[25618]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:14:39.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:38 smithi136 ceph-mon[25618]: Saving service rgw.foo spec with placement count:2 2024-05-25T05:14:39.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:38 smithi136 ceph-mon[25618]: Saving service rgw.foo spec with placement count:2 2024-05-25T05:14:39.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:38 smithi136 ceph-mon[25618]: Deploying daemon rgw.foo.smithi088.beqodg on smithi088 2024-05-25T05:14:39.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[24736]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:14:39.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[24736]: Saving service rgw.foo spec with placement count:2 2024-05-25T05:14:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[24736]: Saving service rgw.foo spec with placement count:2 2024-05-25T05:14:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[24736]: Deploying daemon rgw.foo.smithi088.beqodg on smithi088 2024-05-25T05:14:39.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[29649]: from='client.24586 -' entity='client.admin' cmd=[{"prefix": "orch apply rgw", "svc_id": "foo", "realm": "r", "zone": "z", "placement": "2", "port": 8000, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:14:39.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[29649]: Saving service rgw.foo spec with placement count:2 2024-05-25T05:14:39.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[29649]: Saving service rgw.foo spec with placement count:2 2024-05-25T05:14:39.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:38 smithi088 ceph-mon[29649]: Deploying daemon rgw.foo.smithi088.beqodg on smithi088 2024-05-25T05:14:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:39 smithi088 ceph-mon[29649]: pgmap v73: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-25T05:14:40.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:39 smithi088 ceph-mon[24736]: pgmap v73: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-25T05:14:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:39 smithi136 ceph-mon[25618]: pgmap v73: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1.2 KiB/s wr, 2 op/s 2024-05-25T05:14:40.760 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:40] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-05-25T05:14:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-05-25T05:14:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-05-25T05:14:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-05-25T05:14:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:14:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:14:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]: dispatch 2024-05-25T05:14:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]: dispatch 2024-05-25T05:14:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]: dispatch 2024-05-25T05:14:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]: dispatch 2024-05-25T05:14:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:14:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:14:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 988 B/s rd, 988 B/s wr, 2 op/s 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]': finished 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: osdmap e72: 8 total, 8 up, 8 in 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:14:41.998 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-25T05:14:41.998 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:41.998 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 988 B/s rd, 988 B/s wr, 2 op/s 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]': finished 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: osdmap e72: 8 total, 8 up, 8 in 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:14:42.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: pgmap v74: 129 pgs: 129 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 988 B/s rd, 988 B/s wr, 2 op/s 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "2.f", "id": [7, 2]}]': finished 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.b", "id": [1, 2]}]': finished 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.13", "id": [1, 2]}]': finished 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "4.1c", "id": [1, 5]}]': finished 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: osdmap e72: 8 total, 8 up, 8 in 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:14:42.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]': finished 2024-05-25T05:14:42.228 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:42.228 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:42.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:14:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:14:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:14:43.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:42 smithi136 ceph-mon[25618]: Deploying daemon rgw.foo.smithi136.bfemvm on smithi136 2024-05-25T05:14:43.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:42 smithi136 ceph-mon[25618]: osdmap e73: 8 total, 8 up, 8 in 2024-05-25T05:14:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:42 smithi088 ceph-mon[24736]: Deploying daemon rgw.foo.smithi136.bfemvm on smithi136 2024-05-25T05:14:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:42 smithi088 ceph-mon[24736]: osdmap e73: 8 total, 8 up, 8 in 2024-05-25T05:14:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:42 smithi088 ceph-mon[29649]: Deploying daemon rgw.foo.smithi136.bfemvm on smithi136 2024-05-25T05:14:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:42 smithi088 ceph-mon[29649]: osdmap e73: 8 total, 8 up, 8 in 2024-05-25T05:14:43.908 INFO:teuthology.orchestra.run.smithi088.stderr:pool 'foo' created 2024-05-25T05:14:44.177 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:43 smithi136 ceph-mon[25618]: pgmap v77: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 989 B/s wr, 2 op/s 2024-05-25T05:14:44.177 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:43 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/607513197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-25T05:14:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:43 smithi088 ceph-mon[24736]: pgmap v77: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 989 B/s wr, 2 op/s 2024-05-25T05:14:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:43 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/607513197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-25T05:14:44.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:43 smithi088 ceph-mon[29649]: pgmap v77: 129 pgs: 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail; 989 B/s rd, 989 B/s wr, 2 op/s 2024-05-25T05:14:44.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:43 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/607513197' entity='client.admin' cmd=[{"prefix": "osd pool create", "pool": "foo"}]: dispatch 2024-05-25T05:14:44.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:44 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/607513197' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-05-25T05:14:44.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:44 smithi088 ceph-mon[24736]: osdmap e74: 8 total, 8 up, 8 in 2024-05-25T05:14:44.945 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:44 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/607513197' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-05-25T05:14:44.945 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:44 smithi088 ceph-mon[29649]: osdmap e74: 8 total, 8 up, 8 in 2024-05-25T05:14:44.971 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'rbd pool init foo' 2024-05-25T05:14:45.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:44 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/607513197' entity='client.admin' cmd='[{"prefix": "osd pool create", "pool": "foo"}]': finished 2024-05-25T05:14:45.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:44 smithi136 ceph-mon[25618]: osdmap e74: 8 total, 8 up, 8 in 2024-05-25T05:14:45.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:14:45] "GET /metrics HTTP/1.1" 200 196830 "" "Prometheus/2.33.4" 2024-05-25T05:14:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:45 smithi136 ceph-mon[25618]: pgmap v79: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:45 smithi136 ceph-mon[25618]: osdmap e75: 8 total, 8 up, 8 in 2024-05-25T05:14:46.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:45 smithi088 ceph-mon[29649]: pgmap v79: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:46.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:45 smithi088 ceph-mon[29649]: osdmap e75: 8 total, 8 up, 8 in 2024-05-25T05:14:46.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:45 smithi088 ceph-mon[24736]: pgmap v79: 161 pgs: 32 unknown, 4 peering, 125 active+clean; 581 KiB data, 52 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:14:46.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:45 smithi088 ceph-mon[24736]: osdmap e75: 8 total, 8 up, 8 in 2024-05-25T05:14:46.598 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:46] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:47.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: osdmap e76: 8 total, 8 up, 8 in 2024-05-25T05:14:47.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/389762657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: osdmap e76: 8 total, 8 up, 8 in 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:47.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/389762657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-25T05:14:47.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:47.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:46 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:47.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: osdmap e76: 8 total, 8 up, 8 in 2024-05-25T05:14:47.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/389762657' entity='client.admin' cmd=[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]: dispatch 2024-05-25T05:14:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:46 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: pgmap v82: 161 pgs: 16 unknown, 4 peering, 141 active+clean; 583 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 4.7 KiB/s wr, 229 op/s 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: Checking dashboard <-> RGW credentials 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:47.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/389762657' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-05-25T05:14:47.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:47 smithi136 ceph-mon[25618]: osdmap e77: 8 total, 8 up, 8 in 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: pgmap v82: 161 pgs: 16 unknown, 4 peering, 141 active+clean; 583 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 4.7 KiB/s wr, 229 op/s 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: Checking dashboard <-> RGW credentials 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/389762657' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-05-25T05:14:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[24736]: osdmap e77: 8 total, 8 up, 8 in 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: pgmap v82: 161 pgs: 16 unknown, 4 peering, 141 active+clean; 583 KiB data, 53 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 4.7 KiB/s wr, 229 op/s 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: Checking dashboard <-> RGW credentials 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:48.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:48.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/389762657' entity='client.admin' cmd='[{"prefix": "osd pool application enable","pool": "foo","app": "rbd"}]': finished 2024-05-25T05:14:48.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:47 smithi088 ceph-mon[29649]: osdmap e77: 8 total, 8 up, 8 in 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[24736]: Checking dashboard <-> RGW credentials 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[24736]: osdmap e78: 8 total, 8 up, 8 in 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[29649]: Checking dashboard <-> RGW credentials 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:48 smithi088 ceph-mon[29649]: osdmap e78: 8 total, 8 up, 8 in 2024-05-25T05:14:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:48 smithi136 ceph-mon[25618]: Checking dashboard <-> RGW credentials 2024-05-25T05:14:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:48 smithi136 ceph-mon[25618]: osdmap e78: 8 total, 8 up, 8 in 2024-05-25T05:14:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:49 smithi088 ceph-mon[24736]: pgmap v84: 161 pgs: 161 active+clean; 584 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 194 KiB/s rd, 7.8 KiB/s wr, 402 op/s; 10 B/s, 0 objects/s recovering 2024-05-25T05:14:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:49 smithi088 ceph-mon[24736]: osdmap e79: 8 total, 8 up, 8 in 2024-05-25T05:14:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:49 smithi088 ceph-mon[29649]: pgmap v84: 161 pgs: 161 active+clean; 584 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 194 KiB/s rd, 7.8 KiB/s wr, 402 op/s; 10 B/s, 0 objects/s recovering 2024-05-25T05:14:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:49 smithi088 ceph-mon[29649]: osdmap e79: 8 total, 8 up, 8 in 2024-05-25T05:14:50.237 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:49 smithi136 ceph-mon[25618]: pgmap v84: 161 pgs: 161 active+clean; 584 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 194 KiB/s rd, 7.8 KiB/s wr, 402 op/s; 10 B/s, 0 objects/s recovering 2024-05-25T05:14:50.237 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:49 smithi136 ceph-mon[25618]: osdmap e79: 8 total, 8 up, 8 in 2024-05-25T05:14:50.501 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:50.524 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch apply iscsi foo u p' 2024-05-25T05:14:51.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:51 smithi136 ceph-mon[25618]: pgmap v87: 161 pgs: 161 active+clean; 584 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 194 KiB/s rd, 7.8 KiB/s wr, 403 op/s; 10 B/s, 0 objects/s recovering 2024-05-25T05:14:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:51.403 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:14:51] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:51.404 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:51 smithi088 ceph-mon[29649]: pgmap v87: 161 pgs: 161 active+clean; 584 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 194 KiB/s rd, 7.8 KiB/s wr, 403 op/s; 10 B/s, 0 objects/s recovering 2024-05-25T05:14:51.404 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:51.404 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:51.405 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:51 smithi088 ceph-mon[24736]: pgmap v87: 161 pgs: 161 active+clean; 584 KiB data, 55 MiB used, 715 GiB / 715 GiB avail; 194 KiB/s rd, 7.8 KiB/s wr, 403 op/s; 10 B/s, 0 objects/s recovering 2024-05-25T05:14:51.405 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:51.405 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:52.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:14:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:14:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:14:52.479 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:52 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:52.479 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:52 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:52.524 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:52 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:52.910 INFO:teuthology.orchestra.run.smithi088.stdout:Scheduled iscsi.foo update... 2024-05-25T05:14:53.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:14:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:53.609 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'sleep 180' 2024-05-25T05:14:54.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 211 KiB/s rd, 3.0 KiB/s wr, 350 op/s; 7 B/s, 0 objects/s recovering 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='client.24712 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: Saving service iscsi.foo spec with placement count:1 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[24736]: osdmap e80: 8 total, 8 up, 8 in 2024-05-25T05:14:54.190 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 211 KiB/s rd, 3.0 KiB/s wr, 350 op/s; 7 B/s, 0 objects/s recovering 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='client.24712 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: Saving service iscsi.foo spec with placement count:1 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.191 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:53 smithi088 ceph-mon[29649]: osdmap e80: 8 total, 8 up, 8 in 2024-05-25T05:14:54.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 211 KiB/s rd, 3.0 KiB/s wr, 350 op/s; 7 B/s, 0 objects/s recovering 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='client.24712 -' entity='client.admin' cmd=[{"prefix": "orch apply iscsi", "pool": "foo", "api_user": "u", "api_password": "p", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: Saving service iscsi.foo spec with placement count:1 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:54.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:53 smithi136 ceph-mon[25618]: osdmap e80: 8 total, 8 up, 8 in 2024-05-25T05:14:55.692 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:14:55] "GET /metrics HTTP/1.1" 200 208123 "" "Prometheus/2.33.4" 2024-05-25T05:14:56.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:55 smithi088 ceph-mon[29649]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 153 KiB/s rd, 853 B/s wr, 229 op/s 2024-05-25T05:14:56.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:55 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:56.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:55 smithi088 ceph-mon[24736]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 153 KiB/s rd, 853 B/s wr, 229 op/s 2024-05-25T05:14:56.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:55 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:55 smithi136 ceph-mon[25618]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 70 MiB used, 715 GiB / 715 GiB avail; 153 KiB/s rd, 853 B/s wr, 229 op/s 2024-05-25T05:14:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:55 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:56.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:14:56 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:14:56] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 146 KiB/s rd, 696 B/s wr, 219 op/s 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: Checking pool "foo" exists for service iscsi.foo 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:14:57.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[24736]: Deploying daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 146 KiB/s rd, 696 B/s wr, 219 op/s 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: Checking pool "foo" exists for service iscsi.foo 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:14:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-25T05:14:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:57 smithi088 ceph-mon[29649]: Deploying daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:14:57.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 146 KiB/s rd, 696 B/s wr, 219 op/s 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: Checking pool "foo" exists for service iscsi.foo 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd='[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]': finished 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:14:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:57 smithi136 ceph-mon[25618]: Deploying daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:14:59.589 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:59 smithi088 ceph-mon[29649]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 613 B/s wr, 198 op/s 2024-05-25T05:14:59.590 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:14:59 smithi088 ceph-mon[29649]: mgrmap e20: y(active, since 2m), standbys: x 2024-05-25T05:14:59.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:59 smithi088 ceph-mon[24736]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 613 B/s wr, 198 op/s 2024-05-25T05:14:59.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:14:59 smithi088 ceph-mon[24736]: mgrmap e20: y(active, since 2m), standbys: x 2024-05-25T05:14:59.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:59 smithi136 ceph-mon[25618]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 132 KiB/s rd, 613 B/s wr, 198 op/s 2024-05-25T05:14:59.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:14:59 smithi136 ceph-mon[25618]: mgrmap e20: y(active, since 2m), standbys: x 2024-05-25T05:15:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: Adding iSCSI gateway http://:@172.21.15.88:5000 to Dashboard 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi088"}]: dispatch 2024-05-25T05:15:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi088"}]: dispatch 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1175582172' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1790910198' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]: dispatch 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]: dispatch 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: Adding iSCSI gateway http://:@172.21.15.88:5000 to Dashboard 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi088"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi088"}]: dispatch 2024-05-25T05:15:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1175582172' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1790910198' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]: dispatch 2024-05-25T05:15:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:00 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: Adding iSCSI gateway http://:@172.21.15.88:5000 to Dashboard 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi088"}]: dispatch 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-add", "name": "smithi088"}]: dispatch 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1175582172' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1790910198' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]: dispatch 2024-05-25T05:15:00.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:00 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]: dispatch 2024-05-25T05:15:01.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[29649]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 511 B/s wr, 165 op/s 2024-05-25T05:15:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]': finished 2024-05-25T05:15:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[29649]: osdmap e81: 8 total, 8 up, 8 in 2024-05-25T05:15:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/926727225' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2846313922"}]: dispatch 2024-05-25T05:15:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[24736]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 511 B/s wr, 165 op/s 2024-05-25T05:15:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]': finished 2024-05-25T05:15:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[24736]: osdmap e81: 8 total, 8 up, 8 in 2024-05-25T05:15:01.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:01 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/926727225' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2846313922"}]: dispatch 2024-05-25T05:15:01.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:01 smithi136 ceph-mon[25618]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 110 KiB/s rd, 511 B/s wr, 165 op/s 2024-05-25T05:15:01.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:01 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3254992861"}]': finished 2024-05-25T05:15:01.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:01 smithi136 ceph-mon[25618]: osdmap e81: 8 total, 8 up, 8 in 2024-05-25T05:15:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:01 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/926727225' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2846313922"}]: dispatch 2024-05-25T05:15:02.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:15:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[29649]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 119 B/s wr, 34 op/s 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/926727225' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2846313922"}]': finished 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[29649]: osdmap e82: 8 total, 8 up, 8 in 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/73880335' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/2448700089"}]: dispatch 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[24736]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 119 B/s wr, 34 op/s 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/926727225' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2846313922"}]': finished 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[24736]: osdmap e82: 8 total, 8 up, 8 in 2024-05-25T05:15:03.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:03 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/73880335' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/2448700089"}]: dispatch 2024-05-25T05:15:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:03 smithi136 ceph-mon[25618]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 22 KiB/s rd, 119 B/s wr, 34 op/s 2024-05-25T05:15:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:03 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/926727225' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2846313922"}]': finished 2024-05-25T05:15:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:03 smithi136 ceph-mon[25618]: osdmap e82: 8 total, 8 up, 8 in 2024-05-25T05:15:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:03 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/73880335' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/2448700089"}]: dispatch 2024-05-25T05:15:03.655 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:03.530Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:03.655 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:03.530Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:15:04.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:15:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:15:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:04 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/73880335' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/2448700089"}]': finished 2024-05-25T05:15:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:04 smithi136 ceph-mon[25618]: osdmap e83: 8 total, 8 up, 8 in 2024-05-25T05:15:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:04 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2207526181' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/685032161"}]: dispatch 2024-05-25T05:15:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:04.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/73880335' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/2448700089"}]': finished 2024-05-25T05:15:04.796 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[24736]: osdmap e83: 8 total, 8 up, 8 in 2024-05-25T05:15:04.797 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2207526181' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/685032161"}]: dispatch 2024-05-25T05:15:04.797 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:04.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/73880335' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/2448700089"}]': finished 2024-05-25T05:15:04.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[29649]: osdmap e83: 8 total, 8 up, 8 in 2024-05-25T05:15:04.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2207526181' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/685032161"}]: dispatch 2024-05-25T05:15:04.797 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:05.610 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:05] "GET /metrics HTTP/1.1" 200 208123 "" "Prometheus/2.33.4" 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[29649]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 170 B/s wr, 1 op/s 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2207526181' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/685032161"}]': finished 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[29649]: osdmap e84: 8 total, 8 up, 8 in 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3387186959' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]: dispatch 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]: dispatch 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[24736]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 170 B/s wr, 1 op/s 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2207526181' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/685032161"}]': finished 2024-05-25T05:15:05.611 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[24736]: osdmap e84: 8 total, 8 up, 8 in 2024-05-25T05:15:05.612 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3387186959' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]: dispatch 2024-05-25T05:15:05.612 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:05 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]: dispatch 2024-05-25T05:15:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:05 smithi136 ceph-mon[25618]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 74 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 170 B/s wr, 1 op/s 2024-05-25T05:15:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:05 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2207526181' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/685032161"}]': finished 2024-05-25T05:15:05.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:05 smithi136 ceph-mon[25618]: osdmap e84: 8 total, 8 up, 8 in 2024-05-25T05:15:05.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:05 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3387186959' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]: dispatch 2024-05-25T05:15:05.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:05 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]: dispatch 2024-05-25T05:15:06.621 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:06 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]': finished 2024-05-25T05:15:06.621 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:06 smithi136 ceph-mon[25618]: osdmap e85: 8 total, 8 up, 8 in 2024-05-25T05:15:06.622 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:06 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1262625037' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]: dispatch 2024-05-25T05:15:06.622 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:06 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]: dispatch 2024-05-25T05:15:07.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:15:06] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]': finished 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[24736]: osdmap e85: 8 total, 8 up, 8 in 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1262625037' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]: dispatch 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]: dispatch 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3566449769"}]': finished 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[29649]: osdmap e85: 8 total, 8 up, 8 in 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1262625037' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]: dispatch 2024-05-25T05:15:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:06 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]: dispatch 2024-05-25T05:15:07.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:07.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]': finished 2024-05-25T05:15:07.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: osdmap e86: 8 total, 8 up, 8 in 2024-05-25T05:15:07.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:07.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:07.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:07.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1880169747' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]: dispatch 2024-05-25T05:15:07.692 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:07 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]: dispatch 2024-05-25T05:15:07.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]': finished 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: osdmap e86: 8 total, 8 up, 8 in 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1880169747' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]: dispatch 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]: dispatch 2024-05-25T05:15:07.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3728950008"}]': finished 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: osdmap e86: 8 total, 8 up, 8 in 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1880169747' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]: dispatch 2024-05-25T05:15:07.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:07 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]: dispatch 2024-05-25T05:15:09.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:08 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]': finished 2024-05-25T05:15:09.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:08 smithi088 ceph-mon[29649]: osdmap e87: 8 total, 8 up, 8 in 2024-05-25T05:15:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:08 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/266381391' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/2448700089"}]: dispatch 2024-05-25T05:15:09.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:08 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]': finished 2024-05-25T05:15:09.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:08 smithi088 ceph-mon[24736]: osdmap e87: 8 total, 8 up, 8 in 2024-05-25T05:15:09.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:08 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/266381391' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/2448700089"}]: dispatch 2024-05-25T05:15:09.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:08 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2974971448"}]': finished 2024-05-25T05:15:09.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:08 smithi136 ceph-mon[25618]: osdmap e87: 8 total, 8 up, 8 in 2024-05-25T05:15:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:08 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/266381391' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/2448700089"}]: dispatch 2024-05-25T05:15:09.802 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:15:09] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:15:10.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[29649]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/266381391' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/2448700089"}]': finished 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[29649]: osdmap e88: 8 total, 8 up, 8 in 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3690368883' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3280524365"}]: dispatch 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[24736]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/266381391' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/2448700089"}]': finished 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[24736]: osdmap e88: 8 total, 8 up, 8 in 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3690368883' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3280524365"}]: dispatch 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:09 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:09 smithi136 ceph-mon[25618]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:09 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/266381391' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/2448700089"}]': finished 2024-05-25T05:15:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:09 smithi136 ceph-mon[25618]: osdmap e88: 8 total, 8 up, 8 in 2024-05-25T05:15:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:09 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3690368883' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3280524365"}]: dispatch 2024-05-25T05:15:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:09 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:09 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:11.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:10 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:10 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3690368883' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3280524365"}]': finished 2024-05-25T05:15:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:10 smithi136 ceph-mon[25618]: osdmap e89: 8 total, 8 up, 8 in 2024-05-25T05:15:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:10 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3159196971' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]: dispatch 2024-05-25T05:15:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:10 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]: dispatch 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3690368883' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3280524365"}]': finished 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[29649]: osdmap e89: 8 total, 8 up, 8 in 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3159196971' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]: dispatch 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]: dispatch 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3690368883' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3280524365"}]': finished 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[24736]: osdmap e89: 8 total, 8 up, 8 in 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3159196971' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]: dispatch 2024-05-25T05:15:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:10 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]: dispatch 2024-05-25T05:15:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:11 smithi136 ceph-mon[25618]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:15:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:11 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]': finished 2024-05-25T05:15:12.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:11 smithi136 ceph-mon[25618]: osdmap e90: 8 total, 8 up, 8 in 2024-05-25T05:15:12.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:11 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2633699276' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3522756593"}]: dispatch 2024-05-25T05:15:12.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:15:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:15:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[29649]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:15:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]': finished 2024-05-25T05:15:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[29649]: osdmap e90: 8 total, 8 up, 8 in 2024-05-25T05:15:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2633699276' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3522756593"}]: dispatch 2024-05-25T05:15:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[24736]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 75 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:15:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1340989008"}]': finished 2024-05-25T05:15:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[24736]: osdmap e90: 8 total, 8 up, 8 in 2024-05-25T05:15:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:11 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2633699276' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3522756593"}]: dispatch 2024-05-25T05:15:13.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:12 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2633699276' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3522756593"}]': finished 2024-05-25T05:15:13.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:12 smithi136 ceph-mon[25618]: osdmap e91: 8 total, 8 up, 8 in 2024-05-25T05:15:13.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:12 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1207718925' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3566449769"}]: dispatch 2024-05-25T05:15:13.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:12 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2633699276' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3522756593"}]': finished 2024-05-25T05:15:13.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:12 smithi088 ceph-mon[24736]: osdmap e91: 8 total, 8 up, 8 in 2024-05-25T05:15:13.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:12 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1207718925' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3566449769"}]: dispatch 2024-05-25T05:15:13.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:12 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2633699276' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3522756593"}]': finished 2024-05-25T05:15:13.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:12 smithi088 ceph-mon[29649]: osdmap e91: 8 total, 8 up, 8 in 2024-05-25T05:15:13.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:12 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1207718925' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3566449769"}]: dispatch 2024-05-25T05:15:13.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:15:13.507Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=6 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:13.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:13.508Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:13.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:13.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:15:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:13 smithi136 ceph-mon[25618]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 76 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:13 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1207718925' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3566449769"}]': finished 2024-05-25T05:15:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:13 smithi136 ceph-mon[25618]: osdmap e92: 8 total, 8 up, 8 in 2024-05-25T05:15:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:13 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/362416177' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2057106370"}]: dispatch 2024-05-25T05:15:14.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[24736]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 76 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:14.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1207718925' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3566449769"}]': finished 2024-05-25T05:15:14.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[24736]: osdmap e92: 8 total, 8 up, 8 in 2024-05-25T05:15:14.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/362416177' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2057106370"}]: dispatch 2024-05-25T05:15:14.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[29649]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 76 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:14.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1207718925' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3566449769"}]': finished 2024-05-25T05:15:14.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[29649]: osdmap e92: 8 total, 8 up, 8 in 2024-05-25T05:15:14.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:13 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/362416177' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2057106370"}]: dispatch 2024-05-25T05:15:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:14 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/362416177' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2057106370"}]': finished 2024-05-25T05:15:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:14 smithi136 ceph-mon[25618]: osdmap e93: 8 total, 8 up, 8 in 2024-05-25T05:15:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:14 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2689636969' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]: dispatch 2024-05-25T05:15:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:14 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]: dispatch 2024-05-25T05:15:15.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/362416177' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2057106370"}]': finished 2024-05-25T05:15:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[29649]: osdmap e93: 8 total, 8 up, 8 in 2024-05-25T05:15:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2689636969' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]: dispatch 2024-05-25T05:15:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]: dispatch 2024-05-25T05:15:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/362416177' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2057106370"}]': finished 2024-05-25T05:15:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[24736]: osdmap e93: 8 total, 8 up, 8 in 2024-05-25T05:15:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2689636969' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]: dispatch 2024-05-25T05:15:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:14 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]: dispatch 2024-05-25T05:15:15.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:15] "GET /metrics HTTP/1.1" 200 208133 "" "Prometheus/2.33.4" 2024-05-25T05:15:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:15 smithi136 ceph-mon[25618]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 76 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:16.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:15 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]': finished 2024-05-25T05:15:16.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:15 smithi136 ceph-mon[25618]: osdmap e94: 8 total, 8 up, 8 in 2024-05-25T05:15:16.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:15 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1941720139' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]: dispatch 2024-05-25T05:15:16.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:15 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]: dispatch 2024-05-25T05:15:16.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[24736]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 76 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]': finished 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[24736]: osdmap e94: 8 total, 8 up, 8 in 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1941720139' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]: dispatch 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]: dispatch 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[29649]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 76 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1577678860"}]': finished 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[29649]: osdmap e94: 8 total, 8 up, 8 in 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1941720139' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]: dispatch 2024-05-25T05:15:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:15 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]: dispatch 2024-05-25T05:15:17.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:16 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]': finished 2024-05-25T05:15:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:16 smithi136 ceph-mon[25618]: osdmap e95: 8 total, 8 up, 8 in 2024-05-25T05:15:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:16 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2845496211' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/912908121"}]: dispatch 2024-05-25T05:15:17.208 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:16 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]': finished 2024-05-25T05:15:17.209 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:16 smithi088 ceph-mon[24736]: osdmap e95: 8 total, 8 up, 8 in 2024-05-25T05:15:17.209 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:16 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2845496211' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/912908121"}]: dispatch 2024-05-25T05:15:17.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:16 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/912908121"}]': finished 2024-05-25T05:15:17.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:16 smithi088 ceph-mon[29649]: osdmap e95: 8 total, 8 up, 8 in 2024-05-25T05:15:17.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:16 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2845496211' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/912908121"}]: dispatch 2024-05-25T05:15:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:17 smithi136 ceph-mon[25618]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:17 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2845496211' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/912908121"}]': finished 2024-05-25T05:15:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:17 smithi136 ceph-mon[25618]: osdmap e96: 8 total, 8 up, 8 in 2024-05-25T05:15:18.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:17 smithi088 ceph-mon[29649]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:18.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:17 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2845496211' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/912908121"}]': finished 2024-05-25T05:15:18.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:17 smithi088 ceph-mon[29649]: osdmap e96: 8 total, 8 up, 8 in 2024-05-25T05:15:18.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:17 smithi088 ceph-mon[24736]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:18.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:17 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2845496211' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/912908121"}]': finished 2024-05-25T05:15:18.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:17 smithi088 ceph-mon[24736]: osdmap e96: 8 total, 8 up, 8 in 2024-05-25T05:15:19.954 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:19 smithi088 ceph-mon[24736]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:19.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:19 smithi088 ceph-mon[29649]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:19 smithi136 ceph-mon[25618]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:21.020 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:20 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:21.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:20 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:20 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:22.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:15:21] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:15:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:21 smithi088 ceph-mon[29649]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:21 smithi088 ceph-mon[24736]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:21 smithi136 ceph-mon[25618]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 80 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:22.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:15:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:15:23.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:22 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:22 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:22 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:22 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:22 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:22 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:23.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:15:23.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:23.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:23.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:23.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:23.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:15:24.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:23 smithi088 ceph-mon[24736]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:15:24.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:23 smithi088 ceph-mon[29649]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:15:24.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:23 smithi136 ceph-mon[25618]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:15:25.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:25] "GET /metrics HTTP/1.1" 200 208178 "" "Prometheus/2.33.4" 2024-05-25T05:15:26.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:25 smithi088 ceph-mon[24736]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:26.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:25 smithi088 ceph-mon[29649]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:26.361 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:25 smithi136 ceph-mon[25618]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:27 smithi136 ceph-mon[25618]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-25T05:15:28.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:27 smithi088 ceph-mon[24736]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-25T05:15:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:27 smithi088 ceph-mon[29649]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-25T05:15:29.988 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:29 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:15:29] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:15:30.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:29 smithi088 ceph-mon[24736]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-05-25T05:15:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:29 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:29 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:29 smithi088 ceph-mon[29649]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-05-25T05:15:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:29 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:29 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:29 smithi136 ceph-mon[25618]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 909 B/s rd, 0 op/s 2024-05-25T05:15:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:29 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:29 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:31.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:30 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:31.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:30 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:31.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:30 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:32.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:31 smithi088 ceph-mon[29649]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:31 smithi088 ceph-mon[24736]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:31 smithi136 ceph-mon[25618]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:32.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:15:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:15:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:15:33.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:15:33.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:15:34.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:34 smithi088 ceph-mon[29649]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:34.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:34 smithi088 ceph-mon[24736]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:34 smithi136 ceph-mon[25618]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:35.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:35] "GET /metrics HTTP/1.1" 200 208178 "" "Prometheus/2.33.4" 2024-05-25T05:15:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:36 smithi088 ceph-mon[29649]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:36 smithi088 ceph-mon[24736]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:36 smithi136 ceph-mon[25618]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:38 smithi088 ceph-mon[24736]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:38 smithi088 ceph-mon[29649]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:38.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:38 smithi136 ceph-mon[25618]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:40.199 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:40 smithi088 ceph-mon[29649]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:40.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:40 smithi088 ceph-mon[24736]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:40.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:40 smithi136 ceph-mon[25618]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:41.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:41 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:41.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:15:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:15:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:41 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:15:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:15:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:41 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:15:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:15:42.076 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:42 smithi088 ceph-mon[29649]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:42.076 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:42 smithi088 ceph-mon[24736]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:42.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:42 smithi136 ceph-mon[25618]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:42.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:15:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:15:42.395 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:15:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:15:43.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:43.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:15:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:15:43.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:15:44.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:44 smithi136 ceph-mon[25618]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:44.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:44 smithi088 ceph-mon[29649]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:44 smithi088 ceph-mon[24736]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:45.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:45] "GET /metrics HTTP/1.1" 200 208129 "" "Prometheus/2.33.4" 2024-05-25T05:15:46.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:46 smithi136 ceph-mon[25618]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:46.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:46 smithi088 ceph-mon[24736]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:46.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:46 smithi088 ceph-mon[29649]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:47.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:47 smithi136 ceph-mon[25618]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:47.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:47 smithi088 ceph-mon[29649]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:47.458 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:47 smithi088 ceph-mon[24736]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:49.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:49 smithi088 ceph-mon[24736]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:49.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:15:49] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:15:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:49 smithi088 ceph-mon[29649]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:49.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:49 smithi136 ceph-mon[25618]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:51.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:50 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:51.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:50 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:51.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:50 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:51.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:50 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:51.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:50 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:51.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:50 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:51.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:50 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:15:51.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:50 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:51.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:50 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:15:52.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:51 smithi088 ceph-mon[24736]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:51 smithi088 ceph-mon[29649]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:51 smithi136 ceph-mon[25618]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:52.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:15:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:15:54.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:53 smithi088 ceph-mon[24736]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:53 smithi088 ceph-mon[29649]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:53 smithi136 ceph-mon[25618]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:55.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:15:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:15:55] "GET /metrics HTTP/1.1" 200 208075 "" "Prometheus/2.33.4" 2024-05-25T05:15:56.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:55 smithi088 ceph-mon[29649]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:56.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:55 smithi088 ceph-mon[24736]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:55 smithi136 ceph-mon[25618]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:15:58.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:57 smithi088 ceph-mon[24736]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:57 smithi088 ceph-mon[29649]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:15:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:57 smithi136 ceph-mon[25618]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:00.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:15:59 smithi088 ceph-mon[29649]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:00.020 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:15:59 smithi088 ceph-mon[24736]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:15:59 smithi136 ceph-mon[25618]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:01.048 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:00 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:01.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:00 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:00 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:02.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:01 smithi088 ceph-mon[24736]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:01 smithi088 ceph-mon[29649]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:01 smithi136 ceph-mon[25618]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:02.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:16:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:16:02.474 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:16:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:16:03.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:03 smithi136 ceph-mon[25618]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:03.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:03.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:03.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:03 smithi088 ceph-mon[29649]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:03.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:03 smithi088 ceph-mon[24736]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:03.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:03.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:05.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:05 smithi088 ceph-mon[29649]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:05.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:05 smithi088 ceph-mon[24736]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:05.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:05] "GET /metrics HTTP/1.1" 200 208075 "" "Prometheus/2.33.4" 2024-05-25T05:16:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:05 smithi136 ceph-mon[25618]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:07 smithi136 ceph-mon[25618]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:16:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:16:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:16:07.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:08.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[24736]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:08.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:16:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:16:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:16:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[29649]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:16:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:16:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:16:08.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:09.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:09 smithi088 ceph-mon[29649]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:09.839 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:09 smithi088 ceph-mon[24736]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:09.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:09 smithi136 ceph-mon[25618]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:10.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:16:09] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:16:11.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:10 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:11.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:10 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:10 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:11.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:11 smithi136 ceph-mon[25618]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:12.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:16:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:16:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:11 smithi088 ceph-mon[29649]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:11 smithi088 ceph-mon[24736]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:13 smithi136 ceph-mon[25618]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:14.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:13 smithi088 ceph-mon[29649]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:14.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:13 smithi088 ceph-mon[24736]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:15.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:15] "GET /metrics HTTP/1.1" 200 208070 "" "Prometheus/2.33.4" 2024-05-25T05:16:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:15 smithi136 ceph-mon[25618]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:16.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:15 smithi088 ceph-mon[29649]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:15 smithi088 ceph-mon[24736]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:18.109 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:17 smithi088 ceph-mon[29649]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:18.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:17 smithi088 ceph-mon[24736]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:17 smithi136 ceph-mon[25618]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:19 smithi088 ceph-mon[24736]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:19 smithi088 ceph-mon[29649]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:19 smithi136 ceph-mon[25618]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:20 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:21.150 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:20 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:21.150 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:20 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:22.072 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:21 smithi088 ceph-mon[24736]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:22.073 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:21 smithi088 ceph-mon[29649]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:21 smithi136 ceph-mon[25618]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:22.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:16:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:16:22.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:16:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:16:23.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:23 smithi088 ceph-mon[29649]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:23.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:23.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:23.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:23 smithi088 ceph-mon[24736]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:23.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:23.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:23.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:23 smithi136 ceph-mon[25618]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:23.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:23.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:25.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:25 smithi088 ceph-mon[29649]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:25 smithi088 ceph-mon[24736]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:25.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:25] "GET /metrics HTTP/1.1" 200 208072 "" "Prometheus/2.33.4" 2024-05-25T05:16:25.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:25 smithi136 ceph-mon[25618]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:27.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:27 smithi136 ceph-mon[25618]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:28.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:27 smithi088 ceph-mon[24736]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:27 smithi088 ceph-mon[29649]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:29.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:29 smithi136 ceph-mon[25618]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:29.947 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:29 smithi088 ceph-mon[29649]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:29.948 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:29 smithi088 ceph-mon[24736]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:30.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:29 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:16:29] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:16:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:30 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:30 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:30 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:31.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:30 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:31.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:30 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:31.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:30 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:31.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:30 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:31.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:30 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:31.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:30 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:32.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:31 smithi088 ceph-mon[24736]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:31 smithi088 ceph-mon[29649]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:31 smithi136 ceph-mon[25618]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:32.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:16:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:16:34.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:33 smithi088 ceph-mon[29649]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:34.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:33 smithi088 ceph-mon[24736]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:33 smithi136 ceph-mon[25618]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:35.718 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:35] "GET /metrics HTTP/1.1" 200 208072 "" "Prometheus/2.33.4" 2024-05-25T05:16:36.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:35 smithi088 ceph-mon[24736]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:35 smithi088 ceph-mon[29649]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:35 smithi136 ceph-mon[25618]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:37 smithi088 ceph-mon[24736]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:37 smithi088 ceph-mon[29649]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:37 smithi136 ceph-mon[25618]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:40.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:39 smithi088 ceph-mon[24736]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:40.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:39 smithi088 ceph-mon[29649]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:40.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:39 smithi136 ceph-mon[25618]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:41.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:40 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:16:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:16:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:40 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:16:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:16:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:40 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:16:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:16:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:41 smithi088 ceph-mon[24736]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:41 smithi088 ceph-mon[29649]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:42.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:41 smithi136 ceph-mon[25618]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:42.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:16:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:16:42.707 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:16:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:16:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:43 smithi136 ceph-mon[25618]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:43.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:43 smithi088 ceph-mon[24736]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:43.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:43.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:43 smithi088 ceph-mon[29649]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:45.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:45 smithi088 ceph-mon[24736]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:45.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:45 smithi088 ceph-mon[29649]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:45.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:45] "GET /metrics HTTP/1.1" 200 208081 "" "Prometheus/2.33.4" 2024-05-25T05:16:45.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:45 smithi136 ceph-mon[25618]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:47.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:47 smithi136 ceph-mon[25618]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:47 smithi088 ceph-mon[29649]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:47 smithi088 ceph-mon[24736]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:49.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:49 smithi088 ceph-mon[29649]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:49.859 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:49 smithi088 ceph-mon[24736]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:49.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:49 smithi136 ceph-mon[25618]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:50.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:16:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:16:51.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:51 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:51.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:51.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:51.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:51 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:51.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:51.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:51 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:16:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:16:52.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:52 smithi088 ceph-mon[24736]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:52.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:52 smithi088 ceph-mon[29649]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:52.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:52 smithi136 ceph-mon[25618]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:52.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:16:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:16:54.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:54 smithi088 ceph-mon[29649]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:54 smithi088 ceph-mon[24736]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:54.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:54 smithi136 ceph-mon[25618]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:55.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:16:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:16:55] "GET /metrics HTTP/1.1" 200 208095 "" "Prometheus/2.33.4" 2024-05-25T05:16:56.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:56 smithi088 ceph-mon[24736]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:56 smithi088 ceph-mon[29649]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:56 smithi136 ceph-mon[25618]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:16:58.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:16:58 smithi088 ceph-mon[24736]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:16:58 smithi088 ceph-mon[29649]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:16:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:16:58 smithi136 ceph-mon[25618]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:00 smithi136 ceph-mon[25618]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:00.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:00 smithi088 ceph-mon[29649]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:00.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:00 smithi088 ceph-mon[24736]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:01.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:01 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:01.523 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:01 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:01.523 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:01 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:02.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:02 smithi136 ceph-mon[25618]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:02.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:17:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:17:02.402 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:02 smithi088 ceph-mon[29649]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:02.403 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:02 smithi088 ceph-mon[24736]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:02.729 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:17:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:17:03.695 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:03 smithi088 ceph-mon[29649]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:03.695 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:03.695 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:03.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:03 smithi088 ceph-mon[24736]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:03.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:03.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:03.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:03 smithi136 ceph-mon[25618]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:03.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:03.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:05.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:05] "GET /metrics HTTP/1.1" 200 208095 "" "Prometheus/2.33.4" 2024-05-25T05:17:05.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:05 smithi136 ceph-mon[25618]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:06.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:05 smithi088 ceph-mon[24736]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:06.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:05 smithi088 ceph-mon[29649]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:07.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:07 smithi136 ceph-mon[25618]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:07.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:17:07.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:17:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:17:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:08.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[29649]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[24736]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:17:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:09.764 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:09 smithi136 ceph-mon[25618]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:09 smithi088 ceph-mon[24736]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:09 smithi088 ceph-mon[29649]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:10.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:10 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:17:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:17:10.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:10 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:10.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:10.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:11.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:10 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:11.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:11.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:11.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:10 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:11.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:11.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:11.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:11 smithi136 ceph-mon[25618]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:12.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:11 smithi088 ceph-mon[24736]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:11 smithi088 ceph-mon[29649]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:12.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:17:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:17:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:13 smithi136 ceph-mon[25618]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:14.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:13 smithi088 ceph-mon[29649]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:13 smithi088 ceph-mon[24736]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:15.593 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:15] "GET /metrics HTTP/1.1" 200 208089 "" "Prometheus/2.33.4" 2024-05-25T05:17:15.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:15 smithi136 ceph-mon[25618]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:15 smithi088 ceph-mon[24736]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:15 smithi088 ceph-mon[29649]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:17 smithi136 ceph-mon[25618]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:17 smithi088 ceph-mon[24736]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:17 smithi088 ceph-mon[29649]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:19.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:19 smithi088 ceph-mon[29649]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:19.859 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:19 smithi088 ceph-mon[24736]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:19 smithi136 ceph-mon[25618]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:20.875 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:20 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:20 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:20.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:20 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:21.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:21 smithi136 ceph-mon[25618]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:22.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:21 smithi088 ceph-mon[29649]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:22.025 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:21 smithi088 ceph-mon[24736]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:22.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:17:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:17:23.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:17:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:17:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:23 smithi136 ceph-mon[25618]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:23.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:23 smithi088 ceph-mon[29649]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:23.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:23.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:23.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:23 smithi088 ceph-mon[24736]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:23.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:23.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:25.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:25] "GET /metrics HTTP/1.1" 200 208031 "" "Prometheus/2.33.4" 2024-05-25T05:17:25.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:25 smithi136 ceph-mon[25618]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:25.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:25 smithi088 ceph-mon[24736]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:25.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:25 smithi088 ceph-mon[29649]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:27.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:27 smithi136 ceph-mon[25618]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:28.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:27 smithi088 ceph-mon[29649]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:27 smithi088 ceph-mon[24736]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:29.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:29 smithi136 ceph-mon[25618]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:30.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:29 smithi088 ceph-mon[29649]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:29 smithi088 ceph-mon[24736]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:30.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:17:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:17:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:30 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:30 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:30 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:31.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:30 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:31.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:30 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:31.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:30 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:30 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:30 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:30 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:31.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:31 smithi088 ceph-mon[29649]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:31.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:31 smithi088 ceph-mon[24736]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:31.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:31 smithi136 ceph-mon[25618]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:32.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:17:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:17:33.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:33 smithi136 ceph-mon[25618]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:34.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:33 smithi088 ceph-mon[29649]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:33 smithi088 ceph-mon[24736]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:35.605 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:35] "GET /metrics HTTP/1.1" 200 208031 "" "Prometheus/2.33.4" 2024-05-25T05:17:35.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:35 smithi136 ceph-mon[25618]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:36.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:35 smithi088 ceph-mon[29649]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:36.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:35 smithi088 ceph-mon[24736]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:37.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:37 smithi136 ceph-mon[25618]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:38.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:37 smithi088 ceph-mon[29649]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:37 smithi088 ceph-mon[24736]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:39.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:39 smithi136 ceph-mon[25618]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:40.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:39 smithi088 ceph-mon[24736]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:39 smithi088 ceph-mon[29649]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:40.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:40 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:17:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:17:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:40 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:17:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:17:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:40 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:17:41.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:17:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:41 smithi136 ceph-mon[25618]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:42.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:41 smithi088 ceph-mon[24736]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:41 smithi088 ceph-mon[29649]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:42.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:17:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:17:43.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:17:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:17:44.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:43 smithi088 ceph-mon[24736]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:43 smithi088 ceph-mon[29649]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:44.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:43 smithi136 ceph-mon[25618]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:44.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:44.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:45.409 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:45] "GET /metrics HTTP/1.1" 200 208029 "" "Prometheus/2.33.4" 2024-05-25T05:17:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:45 smithi088 ceph-mon[24736]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:45 smithi088 ceph-mon[29649]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:45 smithi136 ceph-mon[25618]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:47 smithi088 ceph-mon[24736]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:47 smithi088 ceph-mon[29649]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:47 smithi136 ceph-mon[25618]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:50.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:49 smithi088 ceph-mon[29649]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:49 smithi088 ceph-mon[24736]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:50.118 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:49 smithi136 ceph-mon[25618]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:50.692 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:17:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:17:51.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:50 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:51.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:50 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:51.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:50 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:51.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:50 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:51.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:50 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:51.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:50 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:51.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:50 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:17:51.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:50 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:51.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:50 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:17:51.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:51 smithi136 ceph-mon[25618]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:52.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:51 smithi088 ceph-mon[24736]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:51 smithi088 ceph-mon[29649]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:52.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:17:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:17:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:53 smithi088 ceph-mon[24736]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:53 smithi088 ceph-mon[29649]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:53 smithi136 ceph-mon[25618]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:55.699 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:17:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:17:55] "GET /metrics HTTP/1.1" 200 208036 "" "Prometheus/2.33.4" 2024-05-25T05:17:56.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:55 smithi088 ceph-mon[24736]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:56.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:55 smithi088 ceph-mon[29649]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:55 smithi136 ceph-mon[25618]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:17:57.174 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim false --force' 2024-05-25T05:17:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:57 smithi088 ceph-mon[24736]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:57 smithi088 ceph-mon[29649]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:57 smithi136 ceph-mon[25618]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:17:59.718 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph config set mon mon_warn_on_insecure_global_id_reclaim_allowed false --force' 2024-05-25T05:18:00.018 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:17:59 smithi088 ceph-mon[29649]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:00.018 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:17:59 smithi088 ceph-mon[24736]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:17:59 smithi136 ceph-mon[25618]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:01.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:00 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:01.016 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:00 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:00 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:01.989 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:01 smithi088 ceph-mon[29649]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:01.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:01 smithi088 ceph-mon[24736]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:01.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:01 smithi136 ceph-mon[25618]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:02.347 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph config set global log_to_journald false --force' 2024-05-25T05:18:02.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:18:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:18:02.966 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:18:02] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:18:03.879 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:03 smithi088 ceph-mon[24736]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:03.879 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:03.879 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:03.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:03 smithi088 ceph-mon[29649]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:03.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:03.880 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:03 smithi136 ceph-mon[25618]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:04.956 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:18:05.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:05] "GET /metrics HTTP/1.1" 200 208036 "" "Prometheus/2.33.4" 2024-05-25T05:18:06.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:05 smithi088 ceph-mon[29649]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:06.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:05 smithi088 ceph-mon[24736]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:05 smithi136 ceph-mon[25618]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[24736]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:18:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:18:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:18:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:08.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[29649]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:08.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:18:08.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:18:08.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:18:08.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:07 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:07 smithi136 ceph-mon[25618]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:18:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:18:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:18:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:07 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:08.312 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 5s ago 9m - - 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 17s ago 9m - - 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (3m) 5s ago 4m 27.9M - ba2b418f427c e7567de1f584 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (3m) 17s ago 3m 55.1M - 8.3.5 dad864ee21e9 e07f64cf0d7b 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (3m) 5s ago 3m 53.0M - 3.5 e1d6a67b021e be01ac06f164 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443 running (8m) 17s ago 8m 412M - 17.2.0 e1d6a67b021e 047da2118251 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:9283 running (10m) 5s ago 10m 464M - 17.2.0 e1d6a67b021e a93f9f434c45 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (10m) 5s ago 10m 51.2M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (9m) 17s ago 9m 42.9M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (9m) 5s ago 9m 40.1M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (4m) 5s ago 4m 14.5M - 1dbe0e931976 8b3011950533 2024-05-25T05:18:08.313 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (4m) 17s ago 4m 16.5M - 1dbe0e931976 25581f6d105b 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (8m) 5s ago 8m 49.6M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (8m) 5s ago 8m 50.2M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (7m) 5s ago 7m 46.1M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (7m) 5s ago 7m 51.7M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (6m) 17s ago 6m 49.1M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (6m) 17s ago 6m 47.4M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (6m) 17s ago 6m 47.8M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (5m) 17s ago 5m 48.7M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (3m) 17s ago 5m 66.1M - 514e6a882f6e 3ab94cbffc5c 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (3m) 5s ago 3m 70.8M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:18:08.314 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (3m) 17s ago 3m 72.2M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:18:09.689 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions' 2024-05-25T05:18:10.003 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:09 smithi088 ceph-mon[29649]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:10.003 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:09 smithi088 ceph-mon[29649]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:10.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:09 smithi088 ceph-mon[24736]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:10.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:09 smithi088 ceph-mon[24736]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:10.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:09 smithi136 ceph-mon[25618]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:10.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:09 smithi136 ceph-mon[25618]: from='client.14964 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:10.668 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:10 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:18:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:18:11.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:10 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:11.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:11.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:11.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:10 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:11.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:11.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:11.107 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:10 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:11.107 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:11.107 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:11.673 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:18:11.673 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:18:11.673 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:18:11.674 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:18:11.675 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:18:11.675 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:18:11.675 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:18:11.675 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 15 2024-05-25T05:18:11.675 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:18:11.675 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:18:12.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:11 smithi088 ceph-mon[24736]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:12.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:11 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3321472279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:18:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:11 smithi088 ceph-mon[29649]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:11 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3321472279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:18:12.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:11 smithi136 ceph-mon[25618]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:12.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:11 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3321472279' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:18:12.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:18:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:18:12.461 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph -s' 2024-05-25T05:18:14.045 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:13 smithi088 ceph-mon[29649]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:14.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:13 smithi088 ceph-mon[24736]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:13 smithi136 ceph-mon[25618]: pgmap v205: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:14.472 INFO:teuthology.orchestra.run.smithi088.stdout: cluster: 2024-05-25T05:18:14.472 INFO:teuthology.orchestra.run.smithi088.stdout: id: 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:18:14.472 INFO:teuthology.orchestra.run.smithi088.stdout: health: HEALTH_OK 2024-05-25T05:18:14.472 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:18:14.472 INFO:teuthology.orchestra.run.smithi088.stdout: services: 2024-05-25T05:18:14.472 INFO:teuthology.orchestra.run.smithi088.stdout: mon: 3 daemons, quorum a,c,b (age 9m) 2024-05-25T05:18:14.472 INFO:teuthology.orchestra.run.smithi088.stdout: mgr: y(active, since 5m), standbys: x 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: osd: 8 osds: 8 up (since 5m), 8 in (since 6m) 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: data: 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: pools: 6 pools, 161 pgs 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: objects: 241 objects, 585 KiB 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: usage: 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: pgs: 161 active+clean 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: io: 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-05-25T05:18:14.473 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:18:15.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:14 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3957705863' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:18:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:14 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3957705863' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:18:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:14 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3957705863' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:18:15.238 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ls' 2024-05-25T05:18:15.542 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:15] "GET /metrics HTTP/1.1" 200 208044 "" "Prometheus/2.33.4" 2024-05-25T05:18:15.801 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:15 smithi088 ceph-mon[24736]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:15.802 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:15 smithi088 ceph-mon[29649]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:15 smithi136 ceph-mon[25618]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-25T05:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout:agent 2/2 14s ago 5m * 2024-05-25T05:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager ?:9093,9094 1/1 14s ago 5m smithi088=a;count:1 2024-05-25T05:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout:grafana ?:3000 1/1 6s ago 5m smithi136=a;count:1 2024-05-25T05:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo 1/1 14s ago 3m count:1 2024-05-25T05:18:17.232 INFO:teuthology.orchestra.run.smithi088.stdout:mgr 2/2 14s ago 9m smithi088=y;smithi136=x;count:2 2024-05-25T05:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout:mon 3/3 14s ago 9m smithi088:172.21.15.88=a;smithi088:[v2:172.21.15.88:3301,v1:172.21.15.88:6790]=c;smithi136:172.21.15.136=b;count:3 2024-05-25T05:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter ?:9100 2/2 14s ago 5m smithi088=a;smithi136=b;count:2 2024-05-25T05:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout:osd 8 14s ago - 2024-05-25T05:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus ?:9095 1/1 6s ago 5m smithi136=a;count:1 2024-05-25T05:18:17.233 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo ?:8000 2/2 14s ago 3m count:2 2024-05-25T05:18:17.951 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:17 smithi088 ceph-mon[24736]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:17.952 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:17 smithi088 ceph-mon[29649]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:17.975 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-05-25T05:18:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:17 smithi136 ceph-mon[25618]: pgmap v207: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:19.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:18 smithi088 ceph-mon[24736]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:18 smithi088 ceph-mon[29649]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:19.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:18 smithi136 ceph-mon[25618]: from='client.24877 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:19 smithi088 ceph-mon[24736]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:19 smithi088 ceph-mon[29649]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:19 smithi136 ceph-mon[25618]: pgmap v208: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:20.426 INFO:teuthology.orchestra.run.smithi088.stdout:Scheduled to redeploy mgr.x on host 'smithi136' 2024-05-25T05:18:21.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:21.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2972224537' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:18:21.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:21.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:18:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2972224537' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:18:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:20 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:18:21.123 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps --refresh' 2024-05-25T05:18:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:20 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:20 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2972224537' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:18:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:20 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:20 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:18:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:21 smithi088 ceph-mon[24736]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:21 smithi088 ceph-mon[24736]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:21 smithi088 ceph-mon[24736]: Schedule redeploy daemon mgr.x 2024-05-25T05:18:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:21 smithi088 ceph-mon[29649]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:21 smithi088 ceph-mon[29649]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:21 smithi088 ceph-mon[29649]: Schedule redeploy daemon mgr.x 2024-05-25T05:18:22.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:18:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:18:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:21 smithi136 ceph-mon[25618]: pgmap v209: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:21 smithi136 ceph-mon[25618]: from='client.14994 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.x", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:21 smithi136 ceph-mon[25618]: Schedule redeploy daemon mgr.x 2024-05-25T05:18:22.953 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:22 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:18:22] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:18:23.603 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 0s ago 9m - - 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 13s ago 9m - - 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (4m) 0s ago 4m 27.9M - ba2b418f427c e7567de1f584 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (4m) 13s ago 4m 55.7M - 8.3.5 dad864ee21e9 e07f64cf0d7b 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (3m) 0s ago 3m 53.1M - 3.5 e1d6a67b021e be01ac06f164 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443 running (9m) 13s ago 9m 412M - 17.2.0 e1d6a67b021e 047da2118251 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:9283 running (10m) 0s ago 10m 465M - 17.2.0 e1d6a67b021e a93f9f434c45 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (10m) 0s ago 10m 51.8M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (9m) 13s ago 9m 40.9M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (9m) 0s ago 9m 40.5M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (5m) 0s ago 5m 14.4M - 1dbe0e931976 8b3011950533 2024-05-25T05:18:23.604 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (5m) 13s ago 5m 16.0M - 1dbe0e931976 25581f6d105b 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (8m) 0s ago 8m 49.8M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (8m) 0s ago 8m 50.4M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (8m) 0s ago 8m 46.3M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (7m) 0s ago 7m 51.9M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (7m) 13s ago 7m 49.3M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (6m) 13s ago 6m 47.6M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (6m) 13s ago 6m 48.0M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (6m) 13s ago 6m 48.9M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (3m) 13s ago 5m 66.1M - 514e6a882f6e 3ab94cbffc5c 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (3m) 0s ago 3m 70.9M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:18:23.605 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (3m) 13s ago 3m 72.3M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:18:23.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:23 smithi088 ceph-mon[24736]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:23.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:24.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:23 smithi136 ceph-mon[25618]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:24.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:24.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:23 smithi088 ceph-mon[29649]: pgmap v210: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:24.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:24.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:24.432 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'sleep 180' 2024-05-25T05:18:25.054 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:24 smithi088 ceph-mon[29649]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:25.054 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:24 smithi088 ceph-mon[24736]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:25.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:24 smithi136 ceph-mon[25618]: from='client.24895 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:18:25.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:25] "GET /metrics HTTP/1.1" 200 208050 "" "Prometheus/2.33.4" 2024-05-25T05:18:26.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:25 smithi088 ceph-mon[29649]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:26.134 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:25 smithi088 ceph-mon[24736]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:26.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:25 smithi136 ceph-mon[25618]: pgmap v211: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:27 smithi088 ceph-mon[24736]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:27 smithi088 ceph-mon[29649]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:27 smithi136 ceph-mon[25618]: pgmap v212: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:30.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:29 smithi088 ceph-mon[24736]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:29 smithi088 ceph-mon[29649]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:29 smithi136 ceph-mon[25618]: pgmap v213: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:30.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:18:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:18:31.151 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:30 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:31.151 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:30 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:31.151 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:30 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:31.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:30 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:31.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:30 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:31.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:30 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:31.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:30 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:31.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:30 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:31.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:30 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:32.128 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:31 smithi136 ceph-mon[25618]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:32.128 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:18:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:18:32.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:31 smithi088 ceph-mon[24736]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:31 smithi088 ceph-mon[29649]: pgmap v214: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:34.069 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:33 smithi136 ceph-mon[25618]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:34.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:33 smithi088 ceph-mon[24736]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:34.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:33 smithi088 ceph-mon[29649]: pgmap v215: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:35.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:35] "GET /metrics HTTP/1.1" 200 208050 "" "Prometheus/2.33.4" 2024-05-25T05:18:36.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:35 smithi088 ceph-mon[24736]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:36.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:35 smithi088 ceph-mon[29649]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:35 smithi136 ceph-mon[25618]: pgmap v216: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:38.187 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:37 smithi136 ceph-mon[25618]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:38.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:37 smithi088 ceph-mon[29649]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:37 smithi088 ceph-mon[24736]: pgmap v217: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:40.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:39 smithi088 ceph-mon[24736]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:39 smithi088 ceph-mon[29649]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:40.367 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:39 smithi136 ceph-mon[25618]: pgmap v218: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:41.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:40 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:41.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:18:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:18:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:40 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:18:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:18:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:40 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:18:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:18:42.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:41 smithi088 ceph-mon[29649]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:42.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:41 smithi088 ceph-mon[24736]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:42.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:41 smithi136 ceph-mon[25618]: pgmap v219: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:42.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:18:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:18:43.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:18:42] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:18:44.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:43 smithi088 ceph-mon[24736]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:44.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:44.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:44.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:43 smithi088 ceph-mon[29649]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:44.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:44.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:44.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:43 smithi136 ceph-mon[25618]: pgmap v220: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:44.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:44.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:45.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:45] "GET /metrics HTTP/1.1" 200 208036 "" "Prometheus/2.33.4" 2024-05-25T05:18:46.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:45 smithi088 ceph-mon[29649]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:46.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:45 smithi088 ceph-mon[24736]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:46.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:45 smithi136 ceph-mon[25618]: pgmap v221: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:47.980 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:47 smithi088 ceph-mon[24736]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:48.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:47 smithi088 ceph-mon[29649]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:47 smithi136 ceph-mon[25618]: pgmap v222: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:50.083 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:49 smithi088 ceph-mon[29649]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:50.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:49 smithi088 ceph-mon[24736]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:49 smithi136 ceph-mon[25618]: pgmap v223: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:50.986 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:18:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:18:51.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:50 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:51.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:50 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:51.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:50 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:51.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:50 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:51.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:50 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:51.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:50 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:51.349 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:50 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:18:51.349 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:50 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:51.349 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:50 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:18:52.292 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:51 smithi136 ceph-mon[25618]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:52.292 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:18:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:18:52.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:51 smithi088 ceph-mon[24736]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:52.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:51 smithi088 ceph-mon[29649]: pgmap v224: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:54.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:53 smithi088 ceph-mon[24736]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:54.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:53 smithi088 ceph-mon[29649]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:54.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:53 smithi136 ceph-mon[25618]: pgmap v225: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:55.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:18:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:18:55] "GET /metrics HTTP/1.1" 200 208039 "" "Prometheus/2.33.4" 2024-05-25T05:18:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:55 smithi088 ceph-mon[24736]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:55 smithi088 ceph-mon[29649]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:55 smithi136 ceph-mon[25618]: pgmap v226: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:18:58.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:57 smithi088 ceph-mon[29649]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:58.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:57 smithi088 ceph-mon[24736]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:18:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:57 smithi136 ceph-mon[25618]: pgmap v227: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:00.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:18:59 smithi088 ceph-mon[29649]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:18:59 smithi088 ceph-mon[24736]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:18:59 smithi136 ceph-mon[25618]: pgmap v228: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:01.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:01 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:01 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:01.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:01 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:02.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:02 smithi088 ceph-mon[29649]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:02 smithi088 ceph-mon[24736]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:02.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:02 smithi136 ceph-mon[25618]: pgmap v229: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:02.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:19:03.209 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:19:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:19:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:03.508Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:03.508Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:04.361 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:04 smithi088 ceph-mon[24736]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:04.361 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:04.361 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:04.361 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:04 smithi088 ceph-mon[29649]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:04.361 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:04.361 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:04.364 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:04 smithi136 ceph-mon[25618]: pgmap v230: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:04.365 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:04.365 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:19:05.106 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:05 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:05.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:05] "GET /metrics HTTP/1.1" 200 208039 "" "Prometheus/2.33.4" 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:19:05.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:19:05.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:05 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:06 smithi136 ceph-mon[25618]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:06 smithi136 ceph-mon[25618]: Deploying daemon mgr.x on smithi136 2024-05-25T05:19:06.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:06 smithi088 ceph-mon[24736]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:06.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:06 smithi088 ceph-mon[24736]: Deploying daemon mgr.x on smithi136 2024-05-25T05:19:06.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:06 smithi088 ceph-mon[29649]: pgmap v231: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:06.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:06 smithi088 ceph-mon[29649]: Deploying daemon mgr.x on smithi136 2024-05-25T05:19:08.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:08 smithi136 ceph-mon[25618]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:08.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:08 smithi088 ceph-mon[29649]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:08 smithi088 ceph-mon[24736]: pgmap v232: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:10.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:10 smithi088 ceph-mon[24736]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:10.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:10 smithi088 ceph-mon[29649]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:10 smithi136 ceph-mon[25618]: pgmap v233: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:11.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:10 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:19:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:19:11.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:11 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:11.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:11 smithi136 ceph-mon[25618]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:11.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:11 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:11.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:11 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:11.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:11.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[29649]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:11.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:11.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:11.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:11.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[24736]: pgmap v234: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:11.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:11.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:11 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:12.314 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:19:13.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:13 smithi136 ceph-mon[25618]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:13.507 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:13 smithi088 ceph-mon[29649]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:13.507 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:13 smithi088 ceph-mon[24736]: pgmap v235: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:13.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:19:13.507Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=4 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:13.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:13.509Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:13.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:13.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:15.598 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:15] "GET /metrics HTTP/1.1" 200 208040 "" "Prometheus/2.33.4" 2024-05-25T05:19:15.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:15 smithi136 ceph-mon[25618]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:16.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:15 smithi088 ceph-mon[29649]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:15 smithi088 ceph-mon[24736]: pgmap v236: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:17 smithi136 ceph-mon[25618]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:18.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:17 smithi088 ceph-mon[29649]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:17 smithi088 ceph-mon[24736]: pgmap v237: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:19.859 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:19 smithi088 ceph-mon[24736]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:19.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:19 smithi088 ceph-mon[29649]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:19 smithi136 ceph-mon[25618]: pgmap v238: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:20.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:20 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:21.044 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:20 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:21.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:20 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:21.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:21 smithi136 ceph-mon[25618]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:22.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:21 smithi088 ceph-mon[24736]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:21 smithi088 ceph-mon[29649]: pgmap v239: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:22.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:19:23.508 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:19:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:19:23.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:23 smithi088 ceph-mon[29649]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:23.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:23.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:23 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:23.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:23 smithi088 ceph-mon[24736]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:23.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:23.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:23 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:23.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:19:23.508Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:23.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:23.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:23.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:23.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:23 smithi136 ceph-mon[25618]: pgmap v240: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:23 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:25.620 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:25] "GET /metrics HTTP/1.1" 200 208039 "" "Prometheus/2.33.4" 2024-05-25T05:19:25.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:25 smithi136 ceph-mon[25618]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:26.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:25 smithi088 ceph-mon[29649]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:25 smithi088 ceph-mon[24736]: pgmap v241: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:27.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:27 smithi136 ceph-mon[25618]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:28.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:27 smithi088 ceph-mon[24736]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:27 smithi088 ceph-mon[29649]: pgmap v242: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:29.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:29 smithi136 ceph-mon[25618]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:30.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:29 smithi088 ceph-mon[24736]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:29 smithi088 ceph-mon[29649]: pgmap v243: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:30.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:30 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:30 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:30 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:31.116 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:19:30] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:19:32.100 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[27150]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:19:32.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:31 smithi136 ceph-mon[25618]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:32.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:31 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:32.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:31 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:32.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:31 smithi088 ceph-mon[29649]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:32.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:31 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:31 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:31 smithi088 ceph-mon[24736]: pgmap v244: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:31 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:31 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:33.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 systemd[1]: Stopping Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:19:33.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 bash[50191]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr.x" found: no such container 2024-05-25T05:19:33.675 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 podman[50202]: 2024-05-25 05:19:33.413532044 +0000 UTC m=+0.147035034 container died 047da21182513c6efa453cd6a85cc267d6ad60ec1a0d9dbfbeb30f3a2ceeff92 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_BRANCH=HEAD, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, distribution-scope=public, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., vcs-type=git, ceph=True, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , version=8, architecture=x86_64) 2024-05-25T05:19:33.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:19:33.509Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:33.510Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": dial tcp 172.21.15.136:8443: connect: connection refused" 2024-05-25T05:19:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:33.511Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:33.959 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:33 smithi136 ceph-mon[25618]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:33.960 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 podman[50202]: 2024-05-25 05:19:33.742206163 +0000 UTC m=+0.475709151 container cleanup 047da21182513c6efa453cd6a85cc267d6ad60ec1a0d9dbfbeb30f3a2ceeff92 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., ceph=True, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, maintainer=Guillaume Abrioux , architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870) 2024-05-25T05:19:33.960 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 bash[50202]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x 2024-05-25T05:19:33.960 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 bash[50227]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr.x" found: no such container 2024-05-25T05:19:34.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:33 smithi088 ceph-mon[29649]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:34.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:33 smithi088 ceph-mon[24736]: pgmap v245: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:34.374 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 podman[50216]: 2024-05-25 05:19:33.960235769 +0000 UTC m=+0.539440618 container remove 047da21182513c6efa453cd6a85cc267d6ad60ec1a0d9dbfbeb30f3a2ceeff92 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, io.openshift.expose-services=, vendor=Red Hat, Inc., distribution-scope=public, vcs-type=git, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, io.openshift.tags=base centos centos-stream, name=centos-stream, io.buildah.version=1.19.8, com.redhat.component=centos-stream-container, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-05-25T05:19:34.374 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:19:34.374 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-05-25T05:19:34.374 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 systemd[1]: Stopped Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:19:34.374 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:33 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Consumed 17.756s CPU time. 2024-05-25T05:19:34.374 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 systemd[1]: Starting Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:19:34.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 podman[50329]: 2024-05-25 05:19:34.277076783 +0000 UTC m=+0.017445304 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:19:34.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 podman[50329]: 2024-05-25 05:19:34.427979785 +0000 UTC m=+0.168348350 container create 1d0d66e6da757a336e9adaac790c6df36bb5e09f499416a276c7624acd0e84b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, GIT_CLEAN=True, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-ea0684c, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:19:34.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 podman[50329]: 2024-05-25 05:19:34.680601471 +0000 UTC m=+0.420969978 container init 1d0d66e6da757a336e9adaac790c6df36bb5e09f499416a276c7624acd0e84b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0, GIT_CLEAN=True, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-25T05:19:34.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 podman[50329]: 2024-05-25 05:19:34.683751509 +0000 UTC m=+0.424120015 container start 1d0d66e6da757a336e9adaac790c6df36bb5e09f499416a276c7624acd0e84b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-25T05:19:34.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 ceph-mgr[50348]: -- 172.21.15.136:0/857960312 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5620d89ce5a0 con 0x5620d89a2800 2024-05-25T05:19:34.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 bash[50329]: 1d0d66e6da757a336e9adaac790c6df36bb5e09f499416a276c7624acd0e84b6 2024-05-25T05:19:34.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 systemd[1]: Started Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:19:34.948 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:34.849+0000 7f778833d200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:19:35.208 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:35.040+0000 7f778833d200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:19:35.209 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:35.148+0000 7f778833d200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:19:35.699 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:35] "GET /metrics HTTP/1.1" 200 208039 "" "Prometheus/2.33.4" 2024-05-25T05:19:35.841 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:35.474+0000 7f778833d200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:19:35.841 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:35.564+0000 7f778833d200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:19:36.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[29649]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[24736]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:19:36.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:36.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:19:36.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:35 smithi136 ceph-mon[25618]: pgmap v246: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:36.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:19:36.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:19:36.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:19:36.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:36.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:36.801+0000 7f778833d200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:19:37.235 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:36.975+0000 7f778833d200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:19:37.236 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:37.155+0000 7f778833d200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:19:37.571 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:37.470+0000 7f778833d200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:19:37.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:37.570+0000 7f778833d200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:19:37.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:37.784+0000 7f778833d200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:19:38.095 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:37 smithi088 ceph-mon[29649]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:38.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:37 smithi088 ceph-mon[24736]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:37 smithi136 ceph-mon[25618]: pgmap v247: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:38.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:37.988+0000 7f778833d200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:19:38.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:38.605+0000 7f778833d200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:19:39.325 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:39.029+0000 7f778833d200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:19:39.326 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:39.125+0000 7f778833d200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:19:39.326 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:39.325+0000 7f778833d200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:19:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:39 smithi136 ceph-mon[25618]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:40.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:39.847+0000 7f778833d200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:19:40.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:39.940+0000 7f778833d200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:19:40.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:39 smithi088 ceph-mon[24736]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:40.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:39 smithi088 ceph-mon[29649]: pgmap v248: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:40.529 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:40.183+0000 7f778833d200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:19:40.529 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:40.316+0000 7f778833d200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:19:40.529 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:40.412+0000 7f778833d200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:19:40.529 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:40.529+0000 7f778833d200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:19:41.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:40 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:41.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:19:41.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:19:41.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:40.831+0000 7f778833d200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:19:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:40 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:19:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:19:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:40 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:19:41.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:19:41.766 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:41.439+0000 7f778833d200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:19:41.767 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:41.659+0000 7f778833d200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:19:41.767 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:19:41] ENGINE Bus STARTING 2024-05-25T05:19:41.767 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: CherryPy Checker: 2024-05-25T05:19:41.767 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: The Application mounted at '' has an empty config. 2024-05-25T05:19:41.767 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:19:41.767 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:19:41] ENGINE Serving on http://:::9283 2024-05-25T05:19:41.767 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:19:41] ENGINE Bus STARTED 2024-05-25T05:19:42.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:19:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:41 smithi136 ceph-mon[25618]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:41 smithi136 ceph-mon[25618]: Standby manager daemon x restarted 2024-05-25T05:19:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:41 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:19:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:41 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:19:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:41 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:19:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:41 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:19:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:41 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:19:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[29649]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[29649]: Standby manager daemon x restarted 2024-05-25T05:19:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:19:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:19:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[24736]: pgmap v249: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[24736]: Standby manager daemon x restarted 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:19:42.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:41 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:19:43.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:42 smithi136 ceph-mon[25618]: mgrmap e21: y(active, since 7m), standbys: x 2024-05-25T05:19:43.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:42 smithi088 ceph-mon[29649]: mgrmap e21: y(active, since 7m), standbys: x 2024-05-25T05:19:43.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:42 smithi088 ceph-mon[24736]: mgrmap e21: y(active, since 7m), standbys: x 2024-05-25T05:19:43.281 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:42.917Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=7 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:43.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:19:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:19:43.557 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:19:43.510Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=5 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:43.557 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:43.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:43.557 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:43.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:44.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:43 smithi136 ceph-mon[25618]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:43 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:44.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:43 smithi088 ceph-mon[24736]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:44.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:44.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:43 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:44.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:43 smithi088 ceph-mon[29649]: pgmap v250: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:44.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:44.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:43 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:45.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:45] "GET /metrics HTTP/1.1" 200 208038 "" "Prometheus/2.33.4" 2024-05-25T05:19:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:45 smithi136 ceph-mon[25618]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:46.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:45 smithi088 ceph-mon[24736]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:46.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:45 smithi088 ceph-mon[29649]: pgmap v251: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:48.092 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:47 smithi136 ceph-mon[25618]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:48.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:47 smithi088 ceph-mon[24736]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:48.234 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:47 smithi088 ceph-mon[29649]: pgmap v252: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:49 smithi136 ceph-mon[25618]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:50.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:49 smithi088 ceph-mon[24736]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:50.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:49 smithi088 ceph-mon[29649]: pgmap v253: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:51.125 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:50 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:51.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:50 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:51.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:50 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:19:51.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:19:50] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:19:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:51 smithi136 ceph-mon[25618]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:52.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:51 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:52.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:19:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:19:52.152 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:51 smithi088 ceph-mon[29649]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:52.152 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:52.152 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:51 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:52.152 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:51 smithi088 ceph-mon[24736]: pgmap v254: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:52.152 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:52.153 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:51 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:53.717 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:19:53.511Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:53.717 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:53.512Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:19:53.718 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:19:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:19:53.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:19:54.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:19:53] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:19:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:53 smithi088 ceph-mon[29649]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:53 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:53 smithi088 ceph-mon[24736]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:53 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:53 smithi136 ceph-mon[25618]: pgmap v255: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:53 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:19:55.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:19:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:19:55] "GET /metrics HTTP/1.1" 200 208049 "" "Prometheus/2.33.4" 2024-05-25T05:19:56.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:55 smithi088 ceph-mon[24736]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:55 smithi088 ceph-mon[29649]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:55 smithi136 ceph-mon[25618]: pgmap v256: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:19:58.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:57 smithi088 ceph-mon[24736]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:57 smithi088 ceph-mon[29649]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:19:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:57 smithi136 ceph-mon[25618]: pgmap v257: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:00.134 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:19:59 smithi088 ceph-mon[24736]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:00.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:19:59 smithi088 ceph-mon[29649]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:19:59 smithi136 ceph-mon[25618]: pgmap v258: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:00 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:00 smithi088 ceph-mon[24736]: overall HEALTH_OK 2024-05-25T05:20:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:00 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:00 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:20:01.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:00 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:01.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:00 smithi136 ceph-mon[25618]: overall HEALTH_OK 2024-05-25T05:20:02.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:01 smithi088 ceph-mon[29649]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:01 smithi088 ceph-mon[24736]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:02.351 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:01 smithi136 ceph-mon[25618]: pgmap v259: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:02.351 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:20:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:20:03.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:20:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:20:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:20:03.511Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:03.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:03.513Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:20:04.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:03 smithi088 ceph-mon[29649]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:04.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:04.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:03 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:04.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:03 smithi088 ceph-mon[24736]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:04.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:04.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:03 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:03 smithi136 ceph-mon[25618]: pgmap v260: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:03 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:05.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:05] "GET /metrics HTTP/1.1" 200 208049 "" "Prometheus/2.33.4" 2024-05-25T05:20:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:05 smithi088 ceph-mon[29649]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:06.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:05 smithi088 ceph-mon[24736]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:05 smithi136 ceph-mon[25618]: pgmap v261: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:08.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:07 smithi088 ceph-mon[24736]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:07 smithi088 ceph-mon[29649]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:08.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:07 smithi136 ceph-mon[25618]: pgmap v262: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:10.149 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:09 smithi088 ceph-mon[29649]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:10.149 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:09 smithi088 ceph-mon[24736]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:09 smithi136 ceph-mon[25618]: pgmap v263: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:11.010 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:10 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:20:10] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:20:11.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:10 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:11.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:11.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:10 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:11.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:10 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:11.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:11.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:10 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:11.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:10 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:11.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:11.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:10 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:12.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:11 smithi088 ceph-mon[24736]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:11 smithi088 ceph-mon[29649]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:11 smithi136 ceph-mon[25618]: pgmap v264: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:12.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:20:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:20:13.513 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:20:13.512Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:13.513 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:13.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:13.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:13.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:20:14.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:13 smithi088 ceph-mon[24736]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:14.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:13 smithi088 ceph-mon[29649]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:14.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:13 smithi136 ceph-mon[25618]: pgmap v265: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:15.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:15] "GET /metrics HTTP/1.1" 200 208043 "" "Prometheus/2.33.4" 2024-05-25T05:20:16.257 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:15 smithi136 ceph-mon[25618]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:16.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:15 smithi088 ceph-mon[24736]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:15 smithi088 ceph-mon[29649]: pgmap v266: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:18.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:17 smithi088 ceph-mon[29649]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:18.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:17 smithi088 ceph-mon[24736]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:18.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:17 smithi136 ceph-mon[25618]: pgmap v267: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:19 smithi088 ceph-mon[24736]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:19 smithi088 ceph-mon[29649]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:19 smithi136 ceph-mon[25618]: pgmap v268: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:21.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:21 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:21.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:21 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:21.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:21 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:22.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:22 smithi088 ceph-mon[29649]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:22 smithi088 ceph-mon[24736]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:22.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:22 smithi136 ceph-mon[25618]: pgmap v269: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:22.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:20:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:20:23.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:20:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:20:23.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:20:23.512Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:23.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:23.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:23.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:23.514Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:20:24.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:24 smithi088 ceph-mon[24736]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:24.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:24 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:24.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:24 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:24.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:24 smithi088 ceph-mon[29649]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:24.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:24 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:24.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:24 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:24.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:24 smithi136 ceph-mon[25618]: pgmap v270: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:24 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:24.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:24 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:25.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:25] "GET /metrics HTTP/1.1" 200 208042 "" "Prometheus/2.33.4" 2024-05-25T05:20:26.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:26 smithi088 ceph-mon[29649]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:26 smithi088 ceph-mon[24736]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:26.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:26 smithi136 ceph-mon[25618]: pgmap v271: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:28.170 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:28 smithi088 ceph-mon[24736]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:28.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:28 smithi088 ceph-mon[29649]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:28 smithi136 ceph-mon[25618]: pgmap v272: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:30.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:30 smithi088 ceph-mon[24736]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:30 smithi088 ceph-mon[29649]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:30 smithi136 ceph-mon[25618]: pgmap v273: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:31.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:31 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:31.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:31 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:31.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:31 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:20:31] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:20:31.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:31 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:32.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:32 smithi088 ceph-mon[29649]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:32 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:32 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:32 smithi088 ceph-mon[24736]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:32 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:32 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:32.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:20:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:20:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:32 smithi136 ceph-mon[25618]: pgmap v274: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:32 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:32 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:20:33.514Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:33.516Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:33.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:33.516Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:20:34.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:34 smithi088 ceph-mon[29649]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:34.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:34 smithi088 ceph-mon[24736]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:34 smithi136 ceph-mon[25618]: pgmap v275: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:35.333 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:20:35.333 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:20:35.333 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:20:35.333 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:35.333 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:20:35.334 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:20:35.334 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:20:35.334 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:20:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:20:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:20:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:35.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:35] "GET /metrics HTTP/1.1" 200 208042 "" "Prometheus/2.33.4" 2024-05-25T05:20:36.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:36 smithi136 ceph-mon[25618]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:36.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:36 smithi088 ceph-mon[29649]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:36.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:36 smithi088 ceph-mon[24736]: pgmap v276: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:38.328 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:38 smithi136 ceph-mon[25618]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:38.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:38 smithi088 ceph-mon[24736]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:38.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:38 smithi088 ceph-mon[29649]: pgmap v277: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:40.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:40 smithi088 ceph-mon[29649]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:40.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:40 smithi088 ceph-mon[24736]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:40.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:40 smithi136 ceph-mon[25618]: pgmap v278: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:41.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:41 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:20:41.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:41 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:20:41.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:41 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:41.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:20:41.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:41 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:20:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:41 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:20:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:41 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:20:42.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:42 smithi136 ceph-mon[25618]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:42.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:20:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:20:42.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:42 smithi088 ceph-mon[29649]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:42 smithi088 ceph-mon[24736]: pgmap v279: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:43.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:20:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:20:43.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:20:43.515Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:20:43.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:43.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:43.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:43.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:20:44.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:44 smithi136 ceph-mon[25618]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:44.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:44 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:44.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:44 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:44.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:44 smithi088 ceph-mon[29649]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:44.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:44 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:44.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:44 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:44 smithi088 ceph-mon[24736]: pgmap v280: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:44 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:44 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:45.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:45] "GET /metrics HTTP/1.1" 200 208041 "" "Prometheus/2.33.4" 2024-05-25T05:20:46.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:46 smithi136 ceph-mon[25618]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:46.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:46 smithi088 ceph-mon[24736]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:46.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:46 smithi088 ceph-mon[29649]: pgmap v281: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:48 smithi136 ceph-mon[25618]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:48.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:48 smithi088 ceph-mon[29649]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:48.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:48 smithi088 ceph-mon[24736]: pgmap v282: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:50.115 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:50 smithi088 ceph-mon[29649]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:50.116 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:50 smithi088 ceph-mon[24736]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:50.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:50 smithi136 ceph-mon[25618]: pgmap v283: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:51.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:51 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:51.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:20:51] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:20:51.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:51 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:51.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:51 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:20:52.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:52 smithi088 ceph-mon[24736]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:52.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:52 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:52.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:52 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:52.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:52 smithi088 ceph-mon[29649]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:52.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:52 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:52.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:52 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:52.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:52 smithi136 ceph-mon[25618]: pgmap v284: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:52 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:52 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:20:52.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:20:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:51] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:20:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:20:53.515Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:53.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:20:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:20:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:20:53.517Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:20:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:54 smithi136 ceph-mon[25618]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:54.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:54 smithi088 ceph-mon[24736]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:54 smithi088 ceph-mon[29649]: pgmap v285: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:55.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:20:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:20:55] "GET /metrics HTTP/1.1" 200 208045 "" "Prometheus/2.33.4" 2024-05-25T05:20:56.238 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:56 smithi136 ceph-mon[25618]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:56.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:56 smithi088 ceph-mon[24736]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:56.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:56 smithi088 ceph-mon[29649]: pgmap v286: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:20:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:20:58 smithi136 ceph-mon[25618]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:58.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:20:58 smithi088 ceph-mon[24736]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:20:58.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:20:58 smithi088 ceph-mon[29649]: pgmap v287: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:00.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:00 smithi088 ceph-mon[24736]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:00 smithi088 ceph-mon[29649]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:00 smithi136 ceph-mon[25618]: pgmap v288: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:01.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:01 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:01 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:01.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:01 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:02.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:02 smithi136 ceph-mon[25618]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:02.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:01] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:21:02.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:02 smithi088 ceph-mon[24736]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:02.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:02 smithi088 ceph-mon[29649]: pgmap v289: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:03.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:21:03] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:21:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:21:03.516Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:03.518Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:03.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:03.518Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:04 smithi136 ceph-mon[25618]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:04.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:04 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:04.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:04 smithi088 ceph-mon[29649]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:04.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:04.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:04 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:04.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:04 smithi088 ceph-mon[24736]: pgmap v290: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:04.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:04.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:04 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:05.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:05] "GET /metrics HTTP/1.1" 200 208045 "" "Prometheus/2.33.4" 2024-05-25T05:21:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:06 smithi136 ceph-mon[25618]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:06.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:06 smithi088 ceph-mon[29649]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:06.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:06 smithi088 ceph-mon[24736]: pgmap v291: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:08 smithi136 ceph-mon[25618]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:08.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:08 smithi088 ceph-mon[29649]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:08.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:08 smithi088 ceph-mon[24736]: pgmap v292: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:10 smithi136 ceph-mon[25618]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:10.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:10 smithi088 ceph-mon[24736]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:10.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:10 smithi088 ceph-mon[29649]: pgmap v293: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:11.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:11 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:11.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:11 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:11.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:11 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:21:11] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:21:11.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:11 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:12.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:12 smithi088 ceph-mon[24736]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:12 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:12 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:12 smithi088 ceph-mon[29649]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:12 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:12 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:12 smithi136 ceph-mon[25618]: pgmap v294: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:12 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:12 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:12.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:11] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:21:13.517 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:13 smithi088 ceph-mon[29649]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:13.517 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:13 smithi088 ceph-mon[24736]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:13.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:13 smithi136 ceph-mon[25618]: pgmap v295: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:13.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:21:13.517Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:13.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:13.519Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:13.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:13.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:15.625 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:15] "GET /metrics HTTP/1.1" 200 208048 "" "Prometheus/2.33.4" 2024-05-25T05:21:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:15 smithi136 ceph-mon[25618]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:15 smithi088 ceph-mon[24736]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:15 smithi088 ceph-mon[29649]: pgmap v296: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:17 smithi136 ceph-mon[25618]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:18.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:17 smithi088 ceph-mon[24736]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:17 smithi088 ceph-mon[29649]: pgmap v297: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:19.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:19 smithi088 ceph-mon[24736]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:19.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:19 smithi088 ceph-mon[29649]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:19 smithi136 ceph-mon[25618]: pgmap v298: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:21.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:20 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:21.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:20 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:20 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:21.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:21 smithi088 ceph-mon[24736]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:21.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:21 smithi088 ceph-mon[29649]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:21.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:21 smithi136 ceph-mon[25618]: pgmap v299: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:22.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:21] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:21:23.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:23 smithi088 ceph-mon[24736]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:23.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:23 smithi088 ceph-mon[29649]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:23.787 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:21:23.518Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 8 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:23.788 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:23.520Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:23.788 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:23.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:24.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:23 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:21:23] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:21:24.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:23 smithi136 ceph-mon[25618]: pgmap v300: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:25.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:24 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:24 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:24 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:24 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:25.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:24 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:25.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:24 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:25.787 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:25 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:25] "GET /metrics HTTP/1.1" 200 208046 "" "Prometheus/2.33.4" 2024-05-25T05:21:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:25 smithi088 ceph-mon[24736]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:25 smithi088 ceph-mon[29649]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:25 smithi136 ceph-mon[25618]: pgmap v301: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:27.046 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:21:27.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:27 smithi136 ceph-mon[25618]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:28.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:27 smithi088 ceph-mon[24736]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:28.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:27 smithi088 ceph-mon[29649]: pgmap v302: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:29.042 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:21:29.042 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 5s ago 12m - - 2024-05-25T05:21:29.042 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 17s ago 12m - - 2024-05-25T05:21:29.042 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (7m) 5s ago 7m 27.0M - ba2b418f427c e7567de1f584 2024-05-25T05:21:29.042 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (7m) 17s ago 7m 54.9M - 8.3.5 dad864ee21e9 e07f64cf0d7b 2024-05-25T05:21:29.042 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (6m) 5s ago 6m 59.6M - 3.5 e1d6a67b021e be01ac06f164 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283 running (114s) 17s ago 12m 453M - 19.0.0-2843-gea0684c0 f9a9809cafd6 1d0d66e6da75 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:9283 running (13m) 5s ago 13m 471M - 17.2.0 e1d6a67b021e a93f9f434c45 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (13m) 5s ago 13m 56.4M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (12m) 17s ago 12m 43.6M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (12m) 5s ago 12m 43.4M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (8m) 5s ago 8m 19.2M - 1dbe0e931976 8b3011950533 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (8m) 17s ago 8m 19.4M - 1dbe0e931976 25581f6d105b 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (11m) 5s ago 11m 51.2M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (11m) 5s ago 11m 51.8M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (11m) 5s ago 11m 47.6M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (10m) 5s ago 10m 53.4M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (10m) 17s ago 10m 50.8M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:21:29.043 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (9m) 17s ago 9m 49.1M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:21:29.044 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (9m) 17s ago 9m 49.3M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:21:29.044 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (9m) 17s ago 9m 50.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:21:29.044 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (7m) 17s ago 8m 66.4M - 514e6a882f6e 3ab94cbffc5c 2024-05-25T05:21:29.044 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (6m) 5s ago 6m 71.7M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:21:29.044 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (6m) 17s ago 6m 73.2M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:21:29.784 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions' 2024-05-25T05:21:30.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:29 smithi088 ceph-mon[24736]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:30.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:29 smithi088 ceph-mon[24736]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:21:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:29 smithi088 ceph-mon[29649]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:29 smithi088 ceph-mon[29649]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:21:30.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:29 smithi136 ceph-mon[25618]: pgmap v303: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:30.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:29 smithi136 ceph-mon[25618]: from='client.24901 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:21:31.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:30 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:30 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:30 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:31.799 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:31 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.136 - - [25/May/2024:05:21:31] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:21:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:31 smithi088 ceph-mon[29649]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:31 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:31 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:31 smithi088 ceph-mon[24736]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:31 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:31 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:32.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:31] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:21:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:31 smithi136 ceph-mon[25618]: pgmap v304: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:21:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:31 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:31 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:32.609 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:21:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:21:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:21:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:21:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:21:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-25T05:21:32.609 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 1 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 14, 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 1 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:21:32.610 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:21:33.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:32 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2722668358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:21:33.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:32 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2722668358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:21:33.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:32 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2722668358' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:21:33.523 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph -s' 2024-05-25T05:21:33.767 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:21:33.519Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs; ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:33.767 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:33.521Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:33.767 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:33 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:33.522Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:34.050 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:33 smithi088 ceph-mon[29649]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:34.050 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:33 smithi088 ceph-mon[24736]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:33 smithi136 ceph-mon[25618]: pgmap v305: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:35.595 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:35] "GET /metrics HTTP/1.1" 200 208046 "" "Prometheus/2.33.4" 2024-05-25T05:21:35.860 INFO:teuthology.orchestra.run.smithi088.stdout: cluster: 2024-05-25T05:21:35.860 INFO:teuthology.orchestra.run.smithi088.stdout: id: 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:21:35.860 INFO:teuthology.orchestra.run.smithi088.stdout: health: HEALTH_OK 2024-05-25T05:21:35.860 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:21:35.860 INFO:teuthology.orchestra.run.smithi088.stdout: services: 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: mon: 3 daemons, quorum a,c,b (age 12m) 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: mgr: y(active, since 8m), standbys: x 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: osd: 8 osds: 8 up (since 9m), 8 in (since 9m) 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: data: 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: pools: 6 pools, 161 pgs 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: objects: 241 objects, 585 KiB 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: usage: 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: pgs: 161 active+clean 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: io: 2024-05-25T05:21:35.861 INFO:teuthology.orchestra.run.smithi088.stdout: client: 853 B/s rd, 0 op/s rd, 0 op/s wr 2024-05-25T05:21:35.862 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:21:35.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[29649]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:35.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:21:35.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:21:35.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:21:35.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:35.862 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[24736]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:35.862 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:21:35.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:21:35.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:21:35.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:35 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:35.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:35 smithi136 ceph-mon[25618]: pgmap v306: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:35.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:21:35.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:21:35.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:21:35.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:35 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:36.632 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph health detail' 2024-05-25T05:21:36.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:36 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2951269984' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:21:36.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:36 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2951269984' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:21:36.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:36 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2951269984' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:21:38.052 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:37 smithi088 ceph-mon[29649]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:38.053 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:37 smithi088 ceph-mon[24736]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:38.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:37 smithi136 ceph-mon[25618]: pgmap v307: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:38.800 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2024-05-25T05:21:39.483 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 2'"'"'' 2024-05-25T05:21:39.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:39 smithi088 ceph-mon[24736]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:39.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:39 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1857278887' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:21:39.790 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:39 smithi088 ceph-mon[29649]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:39.790 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:39 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1857278887' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:21:39.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:39 smithi136 ceph-mon[25618]: pgmap v308: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:39.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:39 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1857278887' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:21:40.758 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:40 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:40.759 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:40.759 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:40 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:40.759 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:40 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:40.759 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:40.759 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:40 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:40.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:40 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:40.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:40.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:40 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:41.550 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:21:41.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:41 smithi088 ceph-mon[24736]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:41.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:41 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/422927141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:21:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:41 smithi088 ceph-mon[29649]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:41 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/422927141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:21:41.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:41 smithi136 ceph-mon[25618]: pgmap v309: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:21:41.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:41 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/422927141' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:21:42.291 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph mgr fail' 2024-05-25T05:21:42.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:41] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:21:43.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:43 smithi088 ceph-mon[24736]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:43 smithi088 ceph-mon[29649]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:43.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:21:43.521Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 7 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:43.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:43.523Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:43.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:43.523Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:44.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:43 smithi136 ceph-mon[25618]: pgmap v310: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:21:44.309 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 172.21.15.88 - - [25/May/2024:05:21:43] "POST /data HTTP/1.1" 200 46 "" "Python-urllib/3.9" 2024-05-25T05:21:45.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:44 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:44 smithi136 ceph-mon[25618]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:44 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/566879533' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:44 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:44 smithi136 ceph-mon[25618]: osdmap e97: 8 total, 8 up, 8 in 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:21:44] ENGINE Bus STOPPING 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:21:44] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:21:44] ENGINE Bus STOPPED 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:21:45] ENGINE Bus STARTING 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:21:45] ENGINE Serving on http://:::9283 2024-05-25T05:21:45.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:21:45] ENGINE Bus STARTED 2024-05-25T05:21:45.139 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:45.139 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[29649]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:45.139 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/566879533' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:21:45.139 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:21:45.139 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[29649]: osdmap e97: 8 total, 8 up, 8 in 2024-05-25T05:21:45.139 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:45.139 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[24736]: from='mgr.14442 172.21.15.88:0/4233013738' entity='mgr.y' 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/566879533' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mon[24736]: osdmap e97: 8 total, 8 up, 8 in 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:44.900+0000 7f067f48a700 -1 mgr handle_mgr_map I was active but no longer am 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setuser ceph since I am not root 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ignoring --setgroup ceph since I am not root 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:44 smithi088 ceph-mgr[24968]: -- 172.21.15.88:0/2042985928 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x561a6f2d2340 con 0x561a6f2ab000 2024-05-25T05:21:45.140 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:45.082+0000 7f3f14034000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:21:45.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:45.219+0000 7f3f14034000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:21:45.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:45.324+0000 7f3f14034000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:21:45.624 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'sleep 180' 2024-05-25T05:21:45.901 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:45.663+0000 7f3f14034000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:21:45.901 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:45.752+0000 7f3f14034000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:21:45.902 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:21:45.902 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: mgrmap e22: x(active, starting, since 0.572634s) 2024-05-25T05:21:45.902 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:21:45.903 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:21:45.903 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:21:45.903 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:21:45.903 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:21:45.903 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:21:45.903 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: Manager daemon x is now available 2024-05-25T05:21:45.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: Queued rgw.foo for migration 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:45.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:21:45.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:21:45.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:21:45.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:21:45.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:21:45.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:45.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:46.158 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:46.158 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:46.158 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.158 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.158 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:21:46.158 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: mgrmap e22: x(active, starting, since 0.572634s) 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:21:46.159 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: Manager daemon x is now available 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: Queued rgw.foo for migration 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-05-25T05:21:46.160 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:21:46.161 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:21:46.162 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:45 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:21:46.162 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:45.914Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=4 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": dial tcp 172.21.15.88:8443: connect: connection refused" 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: mgrmap e22: x(active, starting, since 0.572634s) 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:21:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: Manager daemon x is now available 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: Queued rgw.foo for migration 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: No Migration is needed for rgw spec: {'placement': {'count': 2}, 'service_id': 'foo', 'service_name': 'rgw.foo', 'service_type': 'rgw', 'spec': {'rgw_frontend_port': 8000, 'rgw_realm': 'r', 'rgw_zone': 'z'}} 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:21:46.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:46.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:21:46.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:45 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:21:47.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:46.955+0000 7f3f14034000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:21:47.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:21:47.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:21:47.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: mgrmap e23: x(active, since 1.58131s) 2024-05-25T05:21:47.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:47.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:21:47.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: [25/May/2024:05:21:46] ENGINE Bus STARTING 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: [25/May/2024:05:21:46] ENGINE Serving on https://172.21.15.136:7150 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: [25/May/2024:05:21:46] ENGINE Serving on http://172.21.15.136:8765 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: [25/May/2024:05:21:46] ENGINE Bus STARTED 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: Reconfiguring daemon agent.smithi088 on smithi088 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[24736]: Deploying cephadm binary to smithi088 2024-05-25T05:21:47.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:21:47.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:21:47.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: mgrmap e23: x(active, since 1.58131s) 2024-05-25T05:21:47.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:47.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:21:47.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: [25/May/2024:05:21:46] ENGINE Bus STARTING 2024-05-25T05:21:47.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:21:47.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: [25/May/2024:05:21:46] ENGINE Serving on https://172.21.15.136:7150 2024-05-25T05:21:47.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: [25/May/2024:05:21:46] ENGINE Serving on http://172.21.15.136:8765 2024-05-25T05:21:47.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: [25/May/2024:05:21:46] ENGINE Bus STARTED 2024-05-25T05:21:47.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:21:47.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:21:47.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: Reconfiguring daemon agent.smithi088 on smithi088 2024-05-25T05:21:47.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:46 smithi088 ceph-mon[29649]: Deploying cephadm binary to smithi088 2024-05-25T05:21:47.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: mgrmap e23: x(active, since 1.58131s) 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: [25/May/2024:05:21:46] ENGINE Bus STARTING 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: [25/May/2024:05:21:46] ENGINE Serving on https://172.21.15.136:7150 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: [25/May/2024:05:21:46] ENGINE Serving on http://172.21.15.136:8765 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: [25/May/2024:05:21:46] ENGINE Bus STARTED 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: Reconfiguring daemon agent.smithi088 on smithi088 2024-05-25T05:21:47.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:46 smithi136 ceph-mon[25618]: Deploying cephadm binary to smithi088 2024-05-25T05:21:47.420 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:47.127+0000 7f3f14034000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:21:47.420 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:47.215+0000 7f3f14034000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:21:47.738 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:47.550+0000 7f3f14034000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:21:47.738 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:47.643+0000 7f3f14034000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:21:48.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:47 smithi088 ceph-mon[24736]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:47 smithi088 ceph-mon[29649]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:48.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:47.738+0000 7f3f14034000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:21:48.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:47.985+0000 7f3f14034000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:21:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:47 smithi136 ceph-mon[25618]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:48.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:48 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:48.433+0000 7f3f14034000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:21:49.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:48 smithi088 ceph-mon[29649]: mgrmap e24: x(active, since 3s) 2024-05-25T05:21:49.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:48 smithi088 ceph-mon[24736]: mgrmap e24: x(active, since 3s) 2024-05-25T05:21:49.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:48 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:48.931+0000 7f3f14034000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:21:49.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:49.028+0000 7f3f14034000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:21:49.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:48 smithi136 ceph-mon[25618]: mgrmap e24: x(active, since 3s) 2024-05-25T05:21:49.602 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:49.335+0000 7f3f14034000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:21:49.603 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:49.432+0000 7f3f14034000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:21:50.118 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:49.866+0000 7f3f14034000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:21:50.118 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:50.044+0000 7f3f14034000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:21:50.384 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:50.161+0000 7f3f14034000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:21:50.385 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:50.284+0000 7f3f14034000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:21:50.385 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:50.384+0000 7f3f14034000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[29649]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[24736]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.707 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:50 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:50 smithi136 ceph-mon[25618]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:50 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:50 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:50 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:50.996 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:50 smithi088 systemd[1]: Stopping Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:21:51.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:50.995+0000 7f3f14034000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:21:51.634 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:51 smithi088 bash[64076]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter.a" found: no such container 2024-05-25T05:21:51.635 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:51.373+0000 7f3f14034000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:21:51.635 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:21:51] ENGINE Bus STARTING 2024-05-25T05:21:51.635 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: CherryPy Checker: 2024-05-25T05:21:51.635 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: The Application mounted at '' has an empty config. 2024-05-25T05:21:51.635 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: 2024-05-25T05:21:51.635 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:21:51] ENGINE Serving on http://:::9283 2024-05-25T05:21:51.635 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: [25/May/2024:05:21:51] ENGINE Bus STARTED 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: Reconfiguring node-exporter.a (dependencies changed)... 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: Reconfiguring daemon node-exporter.a on smithi088 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: Standby manager daemon y started 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:21:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:51 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: Reconfiguring node-exporter.a (dependencies changed)... 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: Reconfiguring daemon node-exporter.a on smithi088 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: Standby manager daemon y started 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:21:52.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: Reconfiguring node-exporter.a (dependencies changed)... 2024-05-25T05:21:52.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: Reconfiguring daemon node-exporter.a on smithi088 2024-05-25T05:21:52.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:21:52.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: Standby manager daemon y started 2024-05-25T05:21:52.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:21:52.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:21:52.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:21:52.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:51 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2313101237' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:21:52.306 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 podman[64140]: 2024-05-25 05:21:52.021188345 +0000 UTC m=+0.459065997 container died 8b301195053369ef9fabe394565a888e0f0d1b65277432df975bd43e12d09098 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:21:52.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:21:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:51] "GET /metrics HTTP/1.1" 200 34893 "" "Prometheus/2.33.4" 2024-05-25T05:21:52.635 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 podman[64140]: 2024-05-25 05:21:52.427336746 +0000 UTC m=+0.865214390 container cleanup 8b301195053369ef9fabe394565a888e0f0d1b65277432df975bd43e12d09098 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:21:52.636 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 bash[64140]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a 2024-05-25T05:21:52.636 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 bash[64205]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter.a" found: no such container 2024-05-25T05:21:52.922 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:52 smithi088 ceph-mon[29649]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:52.922 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:52 smithi088 ceph-mon[29649]: mgrmap e25: x(active, since 7s), standbys: y 2024-05-25T05:21:52.922 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:52 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:21:52.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:52 smithi088 ceph-mon[24736]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:52.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:52 smithi088 ceph-mon[24736]: mgrmap e25: x(active, since 7s), standbys: y 2024-05-25T05:21:52.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:52 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:21:52.923 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 podman[64174]: 2024-05-25 05:21:52.687157857 +0000 UTC m=+0.669035160 container remove 8b301195053369ef9fabe394565a888e0f0d1b65277432df975bd43e12d09098 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:21:52.923 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:21:52.923 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-05-25T05:21:52.923 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 systemd[1]: Stopped Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:21:52.923 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Consumed 3.786s CPU time. 2024-05-25T05:21:52.923 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 systemd[1]: Starting Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:21:53.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:52 smithi136 ceph-mon[25618]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:21:53.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:52 smithi136 ceph-mon[25618]: mgrmap e25: x(active, since 7s), standbys: y 2024-05-25T05:21:53.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:52 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:21:53.198 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 podman[64270]: 2024-05-25 05:21:52.825134266 +0000 UTC m=+0.021072258 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-25T05:21:53.198 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:52 smithi088 podman[64270]: 2024-05-25 05:21:52.956993345 +0000 UTC m=+0.152931317 container create a11a34b18e2942fdeded5f95778e77ea087fefa4f699233716a854cf2e404018 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:21:53.475 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 podman[64270]: 2024-05-25 05:21:53.199038897 +0000 UTC m=+0.394976874 container init a11a34b18e2942fdeded5f95778e77ea087fefa4f699233716a854cf2e404018 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 podman[64270]: 2024-05-25 05:21:53.201874115 +0000 UTC m=+0.397812101 container start a11a34b18e2942fdeded5f95778e77ea087fefa4f699233716a854cf2e404018 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.204Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.205Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.205Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.205Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=arp 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-25T05:21:53.476 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=edac 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-25T05:21:53.477 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=os 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-25T05:21:53.478 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=stat 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=time 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=uname 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-25T05:21:53.479 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-25T05:21:53.480 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[64296]: ts=2024-05-25T05:21:53.206Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-25T05:21:53.480 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 bash[64270]: a11a34b18e2942fdeded5f95778e77ea087fefa4f699233716a854cf2e404018 2024-05-25T05:21:53.480 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:21:53 smithi088 systemd[1]: Started Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:21:53.802 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=error ts=2024-05-25T05:21:53.521Z caller=dispatch.go:354 component=dispatcher msg="Notify for alerts failed" num_alerts=8 err="ceph-dashboard/webhook[1]: notify retry canceled after 8 attempts: Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs; ceph-dashboard/webhook[0]: notify retry canceled after 7 attempts: Post \"https://172.21.15.88:8443//api/prometheus_receiver\": dial tcp 172.21.15.88:8443: connect: connection refused" 2024-05-25T05:21:53.802 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:53.523Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[1] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.136:8443/api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.136 because it doesn't contain any IP SANs" 2024-05-25T05:21:53.802 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=warn ts=2024-05-25T05:21:53.524Z caller=notify.go:724 component=dispatcher receiver=ceph-dashboard integration=webhook[0] msg="Notify attempt failed, will retry later" attempts=1 err="Post \"https://172.21.15.88:8443//api/prometheus_receiver\": x509: cannot validate certificate for 172.21.15.88 because it doesn't contain any IP SANs" 2024-05-25T05:21:54.547 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[24736]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:21:54.547 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[24736]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[24736]: Reconfiguring daemon alertmanager.a on smithi088 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[29649]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[29649]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-25T05:21:54.548 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:54 smithi088 ceph-mon[29649]: Reconfiguring daemon alertmanager.a on smithi088 2024-05-25T05:21:54.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:54 smithi136 ceph-mon[25618]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:21:54.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:54 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:54 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:21:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:54 smithi136 ceph-mon[25618]: Reconfiguring alertmanager.a (dependencies changed)... 2024-05-25T05:21:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:54 smithi136 ceph-mon[25618]: Reconfiguring daemon alertmanager.a on smithi088 2024-05-25T05:21:55.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:21:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:21:55] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:21:56.443 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:56 smithi088 ceph-mon[29649]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:21:56.443 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:56 smithi088 ceph-mon[24736]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:21:56.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:56 smithi136 ceph-mon[25618]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:21:58.522 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:21:58 smithi088 ceph-mon[29649]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:21:58.522 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:21:58 smithi088 ceph-mon[24736]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:21:58.625 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:21:58 smithi136 ceph-mon[25618]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:21:59.737 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:59 smithi088 systemd[1]: Stopping Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:21:59.737 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:59 smithi088 bash[64879]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager.a" found: no such container 2024-05-25T05:22:00.056 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[51142]: level=info ts=2024-05-25T05:21:59.737Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:22:00.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:21:59 smithi088 podman[64890]: 2024-05-25 05:21:59.778564433 +0000 UTC m=+0.208321473 container died e7567de1f5841269589eedd99bafdc2a21cb57f83f6c2b046ee0d1a10118ea26 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:00.396 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 podman[64890]: 2024-05-25 05:22:00.171186935 +0000 UTC m=+0.600943964 container cleanup e7567de1f5841269589eedd99bafdc2a21cb57f83f6c2b046ee0d1a10118ea26 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:00.396 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 bash[64890]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a 2024-05-25T05:22:00.397 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 bash[64923]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager.a" found: no such container 2024-05-25T05:22:00.725 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:00 smithi088 ceph-mon[24736]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:00.725 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:00.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:00 smithi088 ceph-mon[29649]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:00.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:00.725 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 podman[64910]: 2024-05-25 05:22:00.397133654 +0000 UTC m=+0.610032120 container remove e7567de1f5841269589eedd99bafdc2a21cb57f83f6c2b046ee0d1a10118ea26 (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:00.725 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 podman[64910]: 2024-05-25 05:22:00.49778825 +0000 UTC m=+0.710686714 volume remove d95d9579604bffffe4bec37c5c1db8f645cb0017b77056d814381ecb1f1afaab 2024-05-25T05:22:00.726 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-25T05:22:00.726 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 systemd[1]: Stopped Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:00.726 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Consumed 1.109s CPU time. 2024-05-25T05:22:00.726 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 systemd[1]: Starting Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:22:00.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:00 smithi136 ceph-mon[25618]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:00.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:01.021 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 podman[64985]: 2024-05-25 05:22:00.628100578 +0000 UTC m=+0.017200686 image pull ba2b418f427c0636d654de8757e830c80168e76482bcc46bb2138e569d6c91d4 quay.io/prometheus/alertmanager:v0.23.0 2024-05-25T05:22:01.021 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 podman[64985]: 2024-05-25 05:22:00.749084076 +0000 UTC m=+0.138184220 volume create 171fe930a3a78f47eb56f220b4b4c0fcc0e0d46908c5cb9522c0879fa6b84278 2024-05-25T05:22:01.021 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:00 smithi088 podman[64985]: 2024-05-25 05:22:00.832719502 +0000 UTC m=+0.221819589 container create 8fd652671476c11de885bb5ff3f4519154085e0398da71187cecd3fcc1855e8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 podman[64985]: 2024-05-25 05:22:01.127817007 +0000 UTC m=+0.516917117 container init 8fd652671476c11de885bb5ff3f4519154085e0398da71187cecd3fcc1855e8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 podman[64985]: 2024-05-25 05:22:01.130780106 +0000 UTC m=+0.519880211 container start 8fd652671476c11de885bb5ff3f4519154085e0398da71187cecd3fcc1855e8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.140Z caller=main.go:225 msg="Starting Alertmanager" version="(version=0.23.0, branch=HEAD, revision=61046b17771a57cfd4c4a51be370ab930a4d7d54)" 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.140Z caller=main.go:226 build_context="(go=go1.16.7, user=root@e21a959be8d2, date=20210825-10:48:55)" 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.141Z caller=cluster.go:184 component=cluster msg="setting advertise address explicitly" addr=172.21.15.88 port=9094 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.142Z caller=cluster.go:671 component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.167Z caller=coordinator.go:113 component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.167Z caller=coordinator.go:126 component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.170Z caller=main.go:518 msg=Listening address=:9093 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:01.170Z caller=tls_config.go:191 msg="TLS is disabled." http2=false 2024-05-25T05:22:01.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 bash[64985]: 8fd652671476c11de885bb5ff3f4519154085e0398da71187cecd3fcc1855e8a 2024-05-25T05:22:01.308 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:01 smithi088 systemd[1]: Started Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:01.894 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[29649]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:01.894 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:01.894 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[24736]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:01.895 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:01 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:01.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:01 smithi136 ceph-mon[25618]: from='client.14835 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:01.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:01 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:01.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:01 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:01.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:01 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:01.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:01 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:01.997 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:01 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:02.313 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:22:01] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:22:02.634 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:02.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.88:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.136:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:02.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:02 smithi088 ceph-mon[29649]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:02.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:02 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:02.932 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:02 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:02.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:02 smithi088 ceph-mon[24736]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:02.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:02 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:02.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:02 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:03.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:02 smithi136 ceph-mon[25618]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:02 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:02 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:03.306 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:03.143Z caller=cluster.go:696 component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.001008024s 2024-05-25T05:22:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:04 smithi088 ceph-mon[29649]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:05.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:04 smithi088 ceph-mon[24736]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:04 smithi136 ceph-mon[25618]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:22:05.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:22:04.832+0000 7f770de6d700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Creating ceph-iscsi config... 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return _run_code(code, main_globals, None, 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:05.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: exec(code, run_globals) 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:05.136 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return future.result(timeout) 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return self.__get_result() 2024-05-25T05:22:05.137 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: raise self._exception 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: use_current_daemon_image=reconfig, 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Creating ceph-iscsi config... 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:05.138 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return _run_code(code, main_globals, None, 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: exec(code, run_globals) 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:05.139 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:05.652 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:22:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[24964]: ::ffff:172.21.15.136 - - [25/May/2024:05:22:05] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:22:06.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:05 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:06.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:05 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:06.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:05 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:06.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:05 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:05 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:05 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:06 smithi088 ceph-mon[24736]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: return future.result(timeout) 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.__get_result() 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: raise self._exception 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:07.059 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:07.060 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:06 smithi088 ceph-mon[24736]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:06 smithi088 ceph-mon[29649]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:07.061 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:07.062 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:07.063 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: return future.result(timeout) 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.__get_result() 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: raise self._exception 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:07.064 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:07.065 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:07.066 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:07.066 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:07.066 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.066 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:06 smithi088 ceph-mon[29649]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:06 smithi136 ceph-mon[25618]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:07.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return future.result(timeout) 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.__get_result() 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: raise self._exception 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:07.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:07.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:07.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:06 smithi136 ceph-mon[25618]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:08.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:07 smithi136 ceph-mon[25618]: Reconfiguring daemon agent.smithi136 on smithi136 2024-05-25T05:22:08.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:07 smithi136 ceph-mon[25618]: Deploying cephadm binary to smithi136 2024-05-25T05:22:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:07 smithi088 ceph-mon[24736]: Reconfiguring daemon agent.smithi136 on smithi136 2024-05-25T05:22:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:07 smithi088 ceph-mon[24736]: Deploying cephadm binary to smithi136 2024-05-25T05:22:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:07 smithi088 ceph-mon[29649]: Reconfiguring daemon agent.smithi136 on smithi136 2024-05-25T05:22:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:07 smithi088 ceph-mon[29649]: Deploying cephadm binary to smithi136 2024-05-25T05:22:08.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:08 smithi136 ceph-mon[25618]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:22:09.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:08 smithi088 ceph-mon[24736]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:22:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:08 smithi088 ceph-mon[29649]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:22:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:10 smithi136 ceph-mon[25618]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:10 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:10 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:10 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:10 smithi136 ceph-mon[25618]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:22:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:10 smithi136 ceph-mon[25618]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:22:10.434 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[29649]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:10.434 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.434 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.434 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.434 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[29649]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:22:10.434 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[29649]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:22:10.434 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[24736]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:10.435 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.435 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.435 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:10.435 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[24736]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:22:10.435 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:10 smithi088 ceph-mon[24736]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:22:11.410 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:22:11 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:22:11.146Z caller=cluster.go:688 component=cluster msg="gossip settled; proceeding" elapsed=10.003823406s 2024-05-25T05:22:12.118 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:22:11] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:22:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:12 smithi136 ceph-mon[25618]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:12.314Z caller=manager.go:609 level=warn component="rule manager" group=pools msg="Evaluating rule failed" rule="alert: CephPoolGrowthWarning\nexpr: (predict_linear(ceph_pool_percent_used[2d], 3600 * 24 * 5) * on(pool_id) group_right()\n ceph_pool_metadata) >= 95\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.9.2\n severity: warning\n type: ceph_default\nannotations:\n description: |\n Pool '{{ $labels.name }}' will be full in less than 5 days assuming the average fill-up rate of the past 48 hours.\n summary: Pool growth rate may soon exceed it's capacity\n" err="found duplicate series for the match group {pool_id=\"1\"} on the left hand-side of the operation: [{instance=\"172.21.15.88:9283\", job=\"ceph\", pool_id=\"1\"}, {instance=\"172.21.15.136:9283\", job=\"ceph\", pool_id=\"1\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:12.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:12 smithi088 ceph-mon[24736]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:12.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:12 smithi088 ceph-mon[29649]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:13.491 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:22:13.491 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 bash[54393]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.491Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.491Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.491Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.491Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.491Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.491Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.492Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.492Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.492Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:22:13.787 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.492Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:22:13.788 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.492Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-25T05:22:13.788 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[44959]: ts=2024-05-25T05:22:13.492Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-25T05:22:14.384 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 podman[54404]: 2024-05-25 05:22:14.131465942 +0000 UTC m=+0.765078246 container died 3ab94cbffc5c5c4b4fc9b5b996165edc18be833bee331078521f1f53aab82d89 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:14.763 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:14 smithi136 ceph-mon[25618]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:14.763 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 podman[54404]: 2024-05-25 05:22:14.537293732 +0000 UTC m=+1.170906057 container cleanup 3ab94cbffc5c5c4b4fc9b5b996165edc18be833bee331078521f1f53aab82d89 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:14.763 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 bash[54404]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:22:14.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:14 smithi088 ceph-mon[24736]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:14.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:14 smithi088 ceph-mon[29649]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s 2024-05-25T05:22:15.031 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 podman[54430]: 2024-05-25 05:22:14.763907111 +0000 UTC m=+1.262753110 container remove 3ab94cbffc5c5c4b4fc9b5b996165edc18be833bee331078521f1f53aab82d89 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:15.031 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 bash[54482]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:22:15.031 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-25T05:22:15.031 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 systemd[1]: Stopped Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:15.031 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Consumed 1.786s CPU time. 2024-05-25T05:22:15.031 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:14 smithi136 systemd[1]: Starting Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:22:15.305 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 podman[54565]: 2024-05-25 05:22:14.935269388 +0000 UTC m=+0.021119030 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-25T05:22:15.634 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 podman[54565]: 2024-05-25 05:22:15.38503444 +0000 UTC m=+0.470884073 container create c0b59a15b0c34bea8c11524a92a1eaed618a99b36384032a89a1712d4d13b0d6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:15.896 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:15 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:15.896 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:15 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:15.929 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:15 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:16.279 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 podman[54565]: 2024-05-25 05:22:15.930423628 +0000 UTC m=+1.016273270 container init c0b59a15b0c34bea8c11524a92a1eaed618a99b36384032a89a1712d4d13b0d6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:16.279 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 podman[54565]: 2024-05-25 05:22:15.933326604 +0000 UTC m=+1.019176242 container start c0b59a15b0c34bea8c11524a92a1eaed618a99b36384032a89a1712d4d13b0d6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.955Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.955Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.955Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.955Z caller=main.go:518 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.955Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.955Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.957Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.957Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.958Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.959Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:22:16.280 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.959Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.478µs 2024-05-25T05:22:16.281 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.959Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:22:16.281 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:15.961Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=2 2024-05-25T05:22:16.281 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 bash[54565]: c0b59a15b0c34bea8c11524a92a1eaed618a99b36384032a89a1712d4d13b0d6 2024-05-25T05:22:16.281 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:16.634 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.422Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=2 2024-05-25T05:22:16.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.422Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=2 2024-05-25T05:22:16.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.422Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=26.166µs wal_replay_duration=462.543414ms total_replay_duration=462.581581ms 2024-05-25T05:22:16.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.425Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:22:16.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.425Z caller=main.go:947 level=info msg="TSDB started" 2024-05-25T05:22:16.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.425Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:22:16.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.447Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=21.752945ms db_storage=743ns remote_storage=1.395µs web_handler=305ns query_engine=891ns scrape=385.49µs scrape_sd=102.704µs notify=10.241µs notify_sd=10.922µs rules=20.915159ms 2024-05-25T05:22:16.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:16.447Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-25T05:22:16.902 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:16 smithi136 ceph-mon[25618]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:22:16.902 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:16 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:16.902 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:16 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:16 smithi088 ceph-mon[24736]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:22:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:16 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:16 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:16 smithi088 ceph-mon[29649]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:22:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:16 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:16 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:17 smithi136 ceph-mon[25618]: Reconfiguring node-exporter.b (dependencies changed)... 2024-05-25T05:22:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:17 smithi136 ceph-mon[25618]: Reconfiguring daemon node-exporter.b on smithi136 2024-05-25T05:22:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:17 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/584102939' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:22:17.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:17 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/207622405' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/659201408"}]: dispatch 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[24736]: Reconfiguring node-exporter.b (dependencies changed)... 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[24736]: Reconfiguring daemon node-exporter.b on smithi136 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/584102939' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/207622405' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/659201408"}]: dispatch 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[29649]: Reconfiguring node-exporter.b (dependencies changed)... 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[29649]: Reconfiguring daemon node-exporter.b on smithi136 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/584102939' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:22:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:17 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/207622405' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/659201408"}]: dispatch 2024-05-25T05:22:18.205 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:18 smithi136 systemd[1]: Stopping Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:22:18.610 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:18 smithi136 bash[54996]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter.b" found: no such container 2024-05-25T05:22:18.884 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:18 smithi136 podman[55025]: 2024-05-25 05:22:18.611455863 +0000 UTC m=+0.396602618 container died 25581f6d105b1b97f0495fb1868a9237c1a35cdc4ba16434e2c9b85d1f464ac9 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:22:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:18 smithi136 ceph-mon[25618]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:22:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:18 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/207622405' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/659201408"}]': finished 2024-05-25T05:22:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:18 smithi136 ceph-mon[25618]: osdmap e98: 8 total, 8 up, 8 in 2024-05-25T05:22:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:18 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2280805692' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]: dispatch 2024-05-25T05:22:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:18 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]: dispatch 2024-05-25T05:22:19.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[24736]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:22:19.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/207622405' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/659201408"}]': finished 2024-05-25T05:22:19.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[24736]: osdmap e98: 8 total, 8 up, 8 in 2024-05-25T05:22:19.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2280805692' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]: dispatch 2024-05-25T05:22:19.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]: dispatch 2024-05-25T05:22:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[29649]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:22:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/207622405' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/659201408"}]': finished 2024-05-25T05:22:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[29649]: osdmap e98: 8 total, 8 up, 8 in 2024-05-25T05:22:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2280805692' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]: dispatch 2024-05-25T05:22:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:18 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]: dispatch 2024-05-25T05:22:19.252 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 podman[55025]: 2024-05-25 05:22:19.009749979 +0000 UTC m=+0.794896732 container cleanup 25581f6d105b1b97f0495fb1868a9237c1a35cdc4ba16434e2c9b85d1f464ac9 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:22:19.252 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 bash[55025]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b 2024-05-25T05:22:19.252 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 bash[55069]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter.b" found: no such container 2024-05-25T05:22:19.521 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 podman[55056]: 2024-05-25 05:22:19.252681812 +0000 UTC m=+0.644640536 container remove 25581f6d105b1b97f0495fb1868a9237c1a35cdc4ba16434e2c9b85d1f464ac9 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:22:19.521 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:22:19.522 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-05-25T05:22:19.522 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 systemd[1]: Stopped Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:19.522 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Consumed 3.804s CPU time. 2024-05-25T05:22:19.522 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:19 smithi136 systemd[1]: Starting Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:22:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:19 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]': finished 2024-05-25T05:22:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:19 smithi136 ceph-mon[25618]: osdmap e99: 8 total, 8 up, 8 in 2024-05-25T05:22:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:19 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1598192101' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3626990987"}]: dispatch 2024-05-25T05:22:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:19 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]': finished 2024-05-25T05:22:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:19 smithi088 ceph-mon[24736]: osdmap e99: 8 total, 8 up, 8 in 2024-05-25T05:22:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:19 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1598192101' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3626990987"}]: dispatch 2024-05-25T05:22:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:19 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1306220663"}]': finished 2024-05-25T05:22:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:19 smithi088 ceph-mon[29649]: osdmap e99: 8 total, 8 up, 8 in 2024-05-25T05:22:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:19 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1598192101' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3626990987"}]: dispatch 2024-05-25T05:22:20.384 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 podman[55210]: 2024-05-25 05:22:20.017127363 +0000 UTC m=+0.016829182 image pull 1dbe0e931976487e20e5cfb272087e08a9779c88fd5e9617ed7042dd9751ec26 quay.io/prometheus/node-exporter:v1.3.1 2024-05-25T05:22:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 podman[55210]: 2024-05-25 05:22:20.150409456 +0000 UTC m=+0.150111259 container create 85883e86481410abc5ee971f84da73a33ec7d7bba34675a75637a43f1eac0c86 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:22:20.661 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 podman[55210]: 2024-05-25 05:22:20.411192728 +0000 UTC m=+0.410894543 container init 85883e86481410abc5ee971f84da73a33ec7d7bba34675a75637a43f1eac0c86 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 podman[55210]: 2024-05-25 05:22:20.414029165 +0000 UTC m=+0.413730978 container start 85883e86481410abc5ee971f84da73a33ec7d7bba34675a75637a43f1eac0c86 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.417Z caller=node_exporter.go:182 level=info msg="Starting node_exporter" version="(version=1.3.1, branch=HEAD, revision=a2321e7b940ddcff26873612bccdf7cd4c42b6b6)" 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.417Z caller=node_exporter.go:183 level=info msg="Build context" build_context="(go=go1.17.3, user=root@243aafa5525c, date=20211205-11:09:49)" 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.417Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+)($|/) 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.417Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:108 level=info msg="Enabled collectors" 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=arp 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=bcache 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=bonding 2024-05-25T05:22:20.662 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=btrfs 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=conntrack 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=cpu 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=cpufreq 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=diskstats 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=dmi 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=edac 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=entropy 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=fibrechannel 2024-05-25T05:22:20.663 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=filefd 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=filesystem 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=hwmon 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=infiniband 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=ipvs 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=loadavg 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=mdadm 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=meminfo 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=netclass 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=netdev 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=netstat 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=nfs 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=nfsd 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=nvme 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=os 2024-05-25T05:22:20.664 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=powersupplyclass 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=pressure 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=rapl 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=schedstat 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=sockstat 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=softnet 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=stat 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=tapestats 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=textfile 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=thermal_zone 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=time 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=udp_queues 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=uname 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=vmstat 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=xfs 2024-05-25T05:22:20.665 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:115 level=info collector=zfs 2024-05-25T05:22:20.666 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=node_exporter.go:199 level=info msg="Listening on" address=:9100 2024-05-25T05:22:20.666 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[55239]: ts=2024-05-25T05:22:20.418Z caller=tls_config.go:195 level=info msg="TLS is disabled." http2=false 2024-05-25T05:22:20.666 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 bash[55210]: 85883e86481410abc5ee971f84da73a33ec7d7bba34675a75637a43f1eac0c86 2024-05-25T05:22:20.666 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:22:20 smithi136 systemd[1]: Started Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1598192101' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3626990987"}]': finished 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: osdmap e100: 8 total, 8 up, 8 in 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1233035256' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]: dispatch 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]: dispatch 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:20.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1598192101' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3626990987"}]': finished 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: osdmap e100: 8 total, 8 up, 8 in 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1233035256' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]: dispatch 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]: dispatch 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:20.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:20 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:22:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1598192101' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3626990987"}]': finished 2024-05-25T05:22:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: osdmap e100: 8 total, 8 up, 8 in 2024-05-25T05:22:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1233035256' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]: dispatch 2024-05-25T05:22:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]: dispatch 2024-05-25T05:22:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:20 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: Reconfiguring grafana.a (dependencies changed)... 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]': finished 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: osdmap e101: 8 total, 8 up, 8 in 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: Reconfiguring daemon grafana.a on smithi136 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1692206419' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]: dispatch 2024-05-25T05:22:21.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:21 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]: dispatch 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: Reconfiguring grafana.a (dependencies changed)... 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]': finished 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: osdmap e101: 8 total, 8 up, 8 in 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: Reconfiguring daemon grafana.a on smithi136 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1692206419' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]: dispatch 2024-05-25T05:22:21.969 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]: dispatch 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: Reconfiguring grafana.a (dependencies changed)... 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: Regenerating cephadm self-signed grafana TLS certificates 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/664471401"}]': finished 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: osdmap e101: 8 total, 8 up, 8 in 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-ssl-verify", "value": "false"}]: dispatch 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: Reconfiguring daemon grafana.a on smithi136 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1692206419' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]: dispatch 2024-05-25T05:22:21.970 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:21 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]: dispatch 2024-05-25T05:22:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:22 smithi136 ceph-mon[25618]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:22:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:22 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]': finished 2024-05-25T05:22:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:22 smithi136 ceph-mon[25618]: osdmap e102: 8 total, 8 up, 8 in 2024-05-25T05:22:22.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:22 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/694064783' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3868046149"}]: dispatch 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[24736]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]': finished 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[24736]: osdmap e102: 8 total, 8 up, 8 in 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/694064783' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3868046149"}]: dispatch 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[29649]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3868046149"}]': finished 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[29649]: osdmap e102: 8 total, 8 up, 8 in 2024-05-25T05:22:23.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:22 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/694064783' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3868046149"}]: dispatch 2024-05-25T05:22:23.635 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:23 smithi136 systemd[1]: Stopping Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:22:23.635 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:23 smithi136 bash[55409]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana.a" found: no such container 2024-05-25T05:22:23.635 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[43960]: t=2024-05-25T05:22:23+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-05-25T05:22:23.635 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:23 smithi136 podman[55420]: 2024-05-25 05:22:23.532140773 +0000 UTC m=+0.113973894 container died e07f64cf0d7b05e876c871dc176637789b0a125fb6592c827ec2e6ab9f040a76 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=236.1648460182, vendor=Red Hat, Inc., io.openshift.tags=base rhel8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, com.redhat.component=ubi8-container, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Ceph Grafana Container, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, summary=Grafana Container configured for Ceph mgr/dashboard integration, distribution-scope=public, maintainer=Paul Cuzner , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8.5, build-date=2022-03-28T10:36:18.413762, io.buildah.version=1.24.2, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=, name=ubi8, architecture=x86_64) 2024-05-25T05:22:24.003 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:23 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/694064783' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3868046149"}]': finished 2024-05-25T05:22:24.003 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:23 smithi136 ceph-mon[25618]: osdmap e103: 8 total, 8 up, 8 in 2024-05-25T05:22:24.003 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:23 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/269781003' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]: dispatch 2024-05-25T05:22:24.003 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:23 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]: dispatch 2024-05-25T05:22:24.004 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:23 smithi136 podman[55420]: 2024-05-25 05:22:23.84725505 +0000 UTC m=+0.429088162 container cleanup e07f64cf0d7b05e876c871dc176637789b0a125fb6592c827ec2e6ab9f040a76 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, vcs-type=git, build-date=2022-03-28T10:36:18.413762, distribution-scope=public, io.buildah.version=1.24.2, maintainer=Paul Cuzner , description=Ceph Grafana Container, release=236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, io.openshift.tags=base rhel8, summary=Grafana Container configured for Ceph mgr/dashboard integration, name=ubi8, vendor=Red Hat, Inc., vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=ubi8-container) 2024-05-25T05:22:24.004 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:23 smithi136 bash[55420]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a 2024-05-25T05:22:24.004 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:23 smithi136 bash[55448]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana.a" found: no such container 2024-05-25T05:22:24.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/694064783' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3868046149"}]': finished 2024-05-25T05:22:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[24736]: osdmap e103: 8 total, 8 up, 8 in 2024-05-25T05:22:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/269781003' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]: dispatch 2024-05-25T05:22:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]: dispatch 2024-05-25T05:22:24.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/694064783' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3868046149"}]': finished 2024-05-25T05:22:24.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[29649]: osdmap e103: 8 total, 8 up, 8 in 2024-05-25T05:22:24.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/269781003' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]: dispatch 2024-05-25T05:22:24.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:23 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]: dispatch 2024-05-25T05:22:24.348 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:22:24] "GET /metrics HTTP/1.1" 200 37892 "" "Prometheus/2.33.4" 2024-05-25T05:22:24.349 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 podman[55432]: 2024-05-25 05:22:24.123810701 +0000 UTC m=+0.591599188 container remove e07f64cf0d7b05e876c871dc176637789b0a125fb6592c827ec2e6ab9f040a76 (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, io.buildah.version=1.24.2, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, distribution-scope=public, summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Paul Cuzner , vcs-type=git, com.redhat.component=ubi8-container, architecture=x86_64, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.openshift.tags=base rhel8, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=236.1648460182, name=ubi8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.expose-services=) 2024-05-25T05:22:24.349 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Deactivated successfully. 2024-05-25T05:22:24.349 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 systemd[1]: Stopped Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:24.349 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Consumed 3.333s CPU time. 2024-05-25T05:22:24.349 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 systemd[1]: Starting Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:22:24.626 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 podman[55509]: 2024-05-25 05:22:24.2513178 +0000 UTC m=+0.016304909 image pull dad864ee21e98e69f4029d1e417aa085001566be0d322fbc75bc6f29b0050c01 quay.io/ceph/ceph-grafana:8.3.5 2024-05-25T05:22:24.626 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 podman[55509]: 2024-05-25 05:22:24.366801774 +0000 UTC m=+0.131788874 container create f5db15f1314a566f8269268c6efd334e9249e871c0977f23339a5d59be551c0a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, build-date=2022-03-28T10:36:18.413762, version=8.5, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, architecture=x86_64, com.redhat.component=ubi8-container, io.openshift.tags=base rhel8, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, release=236.1648460182, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, io.openshift.expose-services=, io.k8s.display-name=Red Hat Universal Base Image 8, name=ubi8, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, io.buildah.version=1.24.2, distribution-scope=public, vendor=Red Hat, Inc., description=Ceph Grafana Container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182) 2024-05-25T05:22:24.626 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 podman[55509]: 2024-05-25 05:22:24.594417684 +0000 UTC m=+0.359404799 container init f5db15f1314a566f8269268c6efd334e9249e871c0977f23339a5d59be551c0a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, io.openshift.tags=base rhel8, summary=Grafana Container configured for Ceph mgr/dashboard integration, description=Ceph Grafana Container, name=ubi8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, maintainer=Paul Cuzner , io.buildah.version=1.24.2, version=8.5, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, build-date=2022-03-28T10:36:18.413762, vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, release=236.1648460182, io.k8s.display-name=Red Hat Universal Base Image 8, distribution-scope=public, com.redhat.component=ubi8-container, io.openshift.expose-services=) 2024-05-25T05:22:24.626 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 podman[55509]: 2024-05-25 05:22:24.597734352 +0000 UTC m=+0.362721462 container start f5db15f1314a566f8269268c6efd334e9249e871c0977f23339a5d59be551c0a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, architecture=x86_64, com.redhat.component=ubi8-container, vcs-type=git, distribution-scope=public, build-date=2022-03-28T10:36:18.413762, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, release=236.1648460182, io.buildah.version=1.24.2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base rhel8, version=8.5, io.k8s.display-name=Red Hat Universal Base Image 8, description=Ceph Grafana Container, vendor=Red Hat, Inc., maintainer=Paul Cuzner , name=ubi8, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, summary=Grafana Container configured for Ceph mgr/dashboard integration) 2024-05-25T05:22:24.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:24 smithi136 ceph-mon[25618]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:24.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:24 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]': finished 2024-05-25T05:22:24.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:24 smithi136 ceph-mon[25618]: osdmap e104: 8 total, 8 up, 8 in 2024-05-25T05:22:24.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Bus STOPPING 2024-05-25T05:22:24.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:22:24.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Bus STOPPED 2024-05-25T05:22:24.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Bus STARTING 2024-05-25T05:22:24.885 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="The state of unified alerting is still not defined. The decision will be made during as we run the database migrations" logger=settings 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=warn msg="falling back to legacy setting of 'min_interval_seconds'; please use the configuration option in the `unified_alerting` section if Grafana 8 alerts are enabled." logger=settings 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Config loaded from" logger=settings file=/usr/share/grafana/conf/defaults.ini 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Config loaded from" logger=settings file=/etc/grafana/grafana.ini 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_DATA=/var/lib/grafana" 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_LOGS=/var/log/grafana" 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Config overridden from Environment variable" logger=settings var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Path Home" logger=settings path=/usr/share/grafana 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Path Data" logger=settings path=/var/lib/grafana 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Path Logs" logger=settings path=/var/log/grafana 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Path Plugins" logger=settings path=/var/lib/grafana/plugins 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Path Provisioning" logger=settings path=/etc/grafana/provisioning 2024-05-25T05:22:24.886 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="App mode production" logger=settings 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Connecting to DB" logger=sqlstore dbtype=sqlite3 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=warn msg="SQLite database file has broader permissions than it should" logger=sqlstore path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Starting DB migrations" logger=migrator 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="migrations completed" logger=migrator performed=0 skipped=377 duration=504.326µs 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Created default organization" logger=sqlstore 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Initialising plugins" logger=plugin.manager 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=input 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=grafana-piechart-panel 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Plugin registered" logger=plugin.manager pluginId=vonage-status-panel 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="Live Push Gateway initialization" logger=live.push_http 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 bash[55509]: f5db15f1314a566f8269268c6efd334e9249e871c0977f23339a5d59be551c0a 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 systemd[1]: Started Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="deleted datasource based on configuration" logger=provisioning.datasources name=Dashboard1 2024-05-25T05:22:24.887 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Dashboard1 uid=P43CA22E17D0F9596 2024-05-25T05:22:24.888 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="inserting datasource from configuration " logger=provisioning.datasources name=Loki uid=P8E80F9AEF21F6940 2024-05-25T05:22:24.888 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="warming cache for startup" logger=ngalert 2024-05-25T05:22:24.888 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="starting MultiOrg Alertmanager" logger=ngalert.multiorg.alertmanager 2024-05-25T05:22:24.888 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:22:24+0000 lvl=info msg="HTTP Server Listen" logger=http.server address=[::]:3000 protocol=https subUrl= socket= 2024-05-25T05:22:25.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:24 smithi088 ceph-mon[24736]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:24 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]': finished 2024-05-25T05:22:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:24 smithi088 ceph-mon[24736]: osdmap e104: 8 total, 8 up, 8 in 2024-05-25T05:22:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:24 smithi088 ceph-mon[29649]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:24 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/2675402558"}]': finished 2024-05-25T05:22:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:24 smithi088 ceph-mon[29649]: osdmap e104: 8 total, 8 up, 8 in 2024-05-25T05:22:25.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Serving on http://:::9283 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Bus STARTED 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Bus STOPPING 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Bus STOPPED 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:24] ENGINE Bus STARTING 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE Serving on http://:::9283 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE Bus STARTED 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE Bus STOPPING 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE Bus STOPPED 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE Bus STARTING 2024-05-25T05:22:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE Serving on http://:::9283 2024-05-25T05:22:25.386 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:22:25] ENGINE Bus STARTED 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.856 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:25.857 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: Deploying daemon agent.smithi088 on smithi088 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[24736]: Deploying daemon agent.smithi136 on smithi136 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:22:25.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-05-25T05:22:25.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: Deploying daemon agent.smithi088 on smithi088 2024-05-25T05:22:25.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:25 smithi088 ceph-mon[29649]: Deploying daemon agent.smithi136 on smithi136 2024-05-25T05:22:26.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:26.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:26.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:22:26.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-alertmanager-api-host", "value": "http://smithi088.front.sepia.ceph.com:9093"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-prometheus-api-host", "value": "http://smithi136.front.sepia.ceph.com:9095"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-grafana-api-url", "value": "https://smithi136.front.sepia.ceph.com:3000"}]: dispatch 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:26.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:26.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:26.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:22:26.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:22:26.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:22:26.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 81 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:26.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: Deploying daemon agent.smithi088 on smithi088 2024-05-25T05:22:26.041 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:25 smithi136 ceph-mon[25618]: Deploying daemon agent.smithi136 on smithi136 2024-05-25T05:22:27.377 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.377 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='client.15081 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:27.377 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.377 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.378 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='client.15081 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.379 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='client.15081 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:27.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:27.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:28 smithi136 ceph-mon[25618]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-25T05:22:28.391 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:28 smithi088 ceph-mon[29649]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-25T05:22:28.392 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:28 smithi088 ceph-mon[24736]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.7 KiB/s rd, 1 op/s 2024-05-25T05:22:28.969 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:28 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:30.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:30 smithi088 ceph-mon[29649]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 705 B/s rd, 0 op/s 2024-05-25T05:22:30.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:30 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:30 smithi088 ceph-mon[24736]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 705 B/s rd, 0 op/s 2024-05-25T05:22:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:30 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:30 smithi136 ceph-mon[25618]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 705 B/s rd, 0 op/s 2024-05-25T05:22:30.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:30 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:22:31.268+0000 7f770de6d700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Creating ceph-iscsi config... 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:31.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return _run_code(code, main_globals, None, 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: exec(code, run_globals) 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:31.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:31.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return future.result(timeout) 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return self.__get_result() 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: raise self._exception 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: use_current_daemon_image=reconfig, 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Creating ceph-iscsi config... 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:31.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return _run_code(code, main_globals, None, 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: exec(code, run_globals) 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:31.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:31.640 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:31.710 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:31.710 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:31.710 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:31.710 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:31.710 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:31.710 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:31.710 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:31.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:31 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:22:31.960 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:31 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:32.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[24736]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 620 B/s rd, 0 op/s 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[24736]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:32.743 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:32.744 INFO:journalctl@ceph.mon.a.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: return future.result(timeout) 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.__get_result() 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: raise self._exception 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:32.745 INFO:journalctl@ceph.mon.a.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:32.746 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[29649]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 620 B/s rd, 0 op/s 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[29649]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.747 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.748 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: return future.result(timeout) 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.__get_result() 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: raise self._exception 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:22:32.749 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:22:32.750 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:32.751 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:32.752 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:32.752 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:32.752 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:32.752 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:32.752 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:32.752 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:32 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:32 smithi136 ceph-mon[25618]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 620 B/s rd, 0 op/s 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:32 smithi136 ceph-mon[25618]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:22:33.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return future.result(timeout) 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.__get_result() 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: raise self._exception 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:22:33.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:22:33.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:22:33.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:32 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:22:33.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:32 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:22:33.884 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:33.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:34 smithi136 ceph-mon[25618]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:22:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:34 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:34 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:34 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:34 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:22:34] "GET /metrics HTTP/1.1" 200 37891 "" "Prometheus/2.33.4" 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[29649]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[24736]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:34.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:34 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[29649]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 910 B/s rd, 0 op/s 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[29649]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 1 op/s 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[24736]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 910 B/s rd, 0 op/s 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[24736]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 1 op/s 2024-05-25T05:22:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:36 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:36 smithi136 ceph-mon[25618]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 910 B/s rd, 0 op/s 2024-05-25T05:22:36.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:36 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:36 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:36 smithi136 ceph-mon[25618]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 960 B/s rd, 1 op/s 2024-05-25T05:22:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:36 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:36 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:36.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:36 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:37.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:22:37.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:37 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2509383495' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:22:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:22:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:22:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:22:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:22:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:22:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:38.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2509383495' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:38.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:38.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:37 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2509383495' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:22:38.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:38 smithi136 ceph-mon[25618]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:22:38.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:38 smithi136 ceph-mon[25618]: Cluster is now healthy 2024-05-25T05:22:38.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:39.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:38 smithi088 ceph-mon[29649]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:22:39.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:38 smithi088 ceph-mon[29649]: Cluster is now healthy 2024-05-25T05:22:39.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:38 smithi088 ceph-mon[24736]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:22:39.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:38 smithi088 ceph-mon[24736]: Cluster is now healthy 2024-05-25T05:22:40.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:39 smithi088 ceph-mon[29649]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:40.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:39 smithi088 ceph-mon[24736]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:39 smithi136 ceph-mon[25618]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:42.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:41 smithi088 ceph-mon[29649]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:41 smithi088 ceph-mon[24736]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:41 smithi136 ceph-mon[25618]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:43 smithi136 ceph-mon[25618]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:43.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:43.507Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:43 smithi088 ceph-mon[29649]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:43 smithi088 ceph-mon[24736]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:44.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:22:44] "GET /metrics HTTP/1.1" 200 37891 "" "Prometheus/2.33.4" 2024-05-25T05:22:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:45 smithi088 ceph-mon[29649]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:45 smithi088 ceph-mon[24736]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:45 smithi136 ceph-mon[25618]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 527 B/s rd, 0 op/s 2024-05-25T05:22:46.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:22:47.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:47 smithi136 ceph-mon[25618]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-05-25T05:22:47.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:47 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:47.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.691 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[24736]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[29649]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 927 B/s rd, 0 op/s 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:47.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:48.726 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:49.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:49 smithi088 ceph-mon[24736]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:49 smithi088 ceph-mon[29649]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:49.826 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:49 smithi136 ceph-mon[25618]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:51.952 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:51 smithi088 ceph-mon[29649]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:51.952 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:51 smithi088 ceph-mon[24736]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:51 smithi136 ceph-mon[25618]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:53 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:53 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:53 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:53 smithi136 ceph-mon[25618]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:53.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:22:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[24736]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:22:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:53 smithi088 ceph-mon[29649]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:54.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:22:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:22:54] "GET /metrics HTTP/1.1" 200 37890 "" "Prometheus/2.33.4" 2024-05-25T05:22:56.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:55 smithi088 ceph-mon[24736]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:56.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:55 smithi088 ceph-mon[29649]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:55 smithi136 ceph-mon[25618]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:22:58.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:57 smithi088 ceph-mon[24736]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:57 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:57 smithi088 ceph-mon[29649]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:57 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:57 smithi136 ceph-mon[25618]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:22:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:57 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:22:59.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:22:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:22:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:00.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:22:59 smithi088 ceph-mon[29649]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:00.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:22:59 smithi088 ceph-mon[24736]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:22:59 smithi136 ceph-mon[25618]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:01.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:02.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:01 smithi088 ceph-mon[29649]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:01 smithi088 ceph-mon[24736]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:01 smithi136 ceph-mon[25618]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:03.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:03 smithi136 ceph-mon[25618]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:03.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:03.507Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:04.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:03 smithi088 ceph-mon[24736]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:04.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:03 smithi088 ceph-mon[29649]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:04.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:23:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:23:04] "GET /metrics HTTP/1.1" 200 37885 "" "Prometheus/2.33.4" 2024-05-25T05:23:05.965 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:05 smithi088 ceph-mon[24736]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:05.965 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:05 smithi088 ceph-mon[29649]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:05 smithi136 ceph-mon[25618]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:07.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.616 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:07.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:07.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.617 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:07.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:09.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:08 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:10.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:09 smithi136 ceph-mon[25618]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:09 smithi088 ceph-mon[24736]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:09 smithi088 ceph-mon[29649]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:12.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:11 smithi088 ceph-mon[24736]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:11 smithi088 ceph-mon[29649]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:11 smithi136 ceph-mon[25618]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:13 smithi136 ceph-mon[25618]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:13.884 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:13.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:13 smithi088 ceph-mon[24736]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:13 smithi088 ceph-mon[29649]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:14.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:23:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:23:14] "GET /metrics HTTP/1.1" 200 37885 "" "Prometheus/2.33.4" 2024-05-25T05:23:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:15 smithi088 ceph-mon[24736]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:15 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:15 smithi088 ceph-mon[29649]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:15 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:15 smithi136 ceph-mon[25618]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:15 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:18.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:17 smithi088 ceph-mon[24736]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:17 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:17 smithi088 ceph-mon[29649]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:17 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:17 smithi136 ceph-mon[25618]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:17 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:19.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:19 smithi088 ceph-mon[24736]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:19 smithi088 ceph-mon[29649]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:20.118 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:19 smithi136 ceph-mon[25618]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:22.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:21 smithi088 ceph-mon[29649]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:21 smithi088 ceph-mon[24736]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:21 smithi136 ceph-mon[25618]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:23.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:23 smithi088 ceph-mon[24736]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:23.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:23 smithi088 ceph-mon[29649]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:23 smithi136 ceph-mon[25618]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:23.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:23.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:24.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:23:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:23:24] "GET /metrics HTTP/1.1" 200 37888 "" "Prometheus/2.33.4" 2024-05-25T05:23:26.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:25 smithi088 ceph-mon[29649]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:25 smithi088 ceph-mon[24736]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:25 smithi136 ceph-mon[25618]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:27.817 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:27.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:27.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:27.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:27.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:27.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:27.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:27.818 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:28.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:28 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:29.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:29 smithi136 ceph-mon[25618]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:30.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:29 smithi088 ceph-mon[29649]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:29 smithi088 ceph-mon[24736]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:31.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:30 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:30 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:30 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:31 smithi088 ceph-mon[24736]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:31 smithi088 ceph-mon[29649]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:31 smithi136 ceph-mon[25618]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:33.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:33 smithi136 ceph-mon[25618]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:33.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:33.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:34.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:33 smithi088 ceph-mon[24736]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:34.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:33 smithi088 ceph-mon[29649]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:34.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:23:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:23:34] "GET /metrics HTTP/1.1" 200 37886 "" "Prometheus/2.33.4" 2024-05-25T05:23:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:35 smithi088 ceph-mon[29649]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:36.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:35 smithi088 ceph-mon[24736]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:35 smithi136 ceph-mon[25618]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:37.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:36 smithi088 ceph-mon[24736]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:37.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:36 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:37.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:36 smithi088 ceph-mon[29649]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:37.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:36 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:37.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:36 smithi136 ceph-mon[25618]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:37.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:36 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:38.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:23:38.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:23:38.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:23:38.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:37 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:38.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:23:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:23:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:23:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:23:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:23:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:23:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:37 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:39.046 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:39.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:39 smithi136 ceph-mon[25618]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:40.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:39 smithi088 ceph-mon[24736]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:39 smithi088 ceph-mon[29649]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:42.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:41 smithi088 ceph-mon[29649]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:41 smithi088 ceph-mon[24736]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:41 smithi136 ceph-mon[25618]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:43.846 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:43 smithi088 ceph-mon[29649]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:43.847 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:43 smithi088 ceph-mon[24736]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:43 smithi136 ceph-mon[25618]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:43.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:43.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:44.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:23:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:23:44] "GET /metrics HTTP/1.1" 200 37886 "" "Prometheus/2.33.4" 2024-05-25T05:23:45.831 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:45 smithi088 ceph-mon[24736]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:45.831 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:45.831 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:45 smithi088 ceph-mon[29649]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:45.831 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:45 smithi136 ceph-mon[25618]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:46.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:23:47.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:47 smithi136 ceph-mon[25618]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:47.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:47 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:47.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:47.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:47.931 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[24736]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[29649]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:48.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:48 smithi136 ceph-mon[25618]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:48.981 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:48.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:49.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:49.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:49.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:49.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[24736]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:49.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:49.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:49.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:23:49.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:48 smithi088 ceph-mon[29649]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:52.010 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:51 smithi088 ceph-mon[24736]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:52.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:51 smithi088 ceph-mon[29649]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:51 smithi136 ceph-mon[25618]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:53 smithi136 ceph-mon[25618]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:53.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:23:54.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:53 smithi088 ceph-mon[24736]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:53 smithi088 ceph-mon[29649]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:54.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:23:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:23:54] "GET /metrics HTTP/1.1" 200 37887 "" "Prometheus/2.33.4" 2024-05-25T05:23:56.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:55 smithi088 ceph-mon[29649]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:56.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:55 smithi088 ceph-mon[24736]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:55 smithi136 ceph-mon[25618]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:23:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:57 smithi088 ceph-mon[29649]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:57 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:57 smithi088 ceph-mon[24736]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:57 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:57 smithi136 ceph-mon[25618]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:23:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:57 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:23:59.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:23:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:23:58.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:00.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:23:59 smithi088 ceph-mon[29649]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:00.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:23:59 smithi088 ceph-mon[24736]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:23:59 smithi136 ceph-mon[25618]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:00.921 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:01.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:01.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:01 smithi136 ceph-mon[25618]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:02.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:01 smithi088 ceph-mon[29649]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:01 smithi088 ceph-mon[24736]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:03.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:03 smithi136 ceph-mon[25618]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:03.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:03.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:03.981 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:03 smithi088 ceph-mon[24736]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:03.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:03 smithi088 ceph-mon[29649]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:04.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:24:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:24:04] "GET /metrics HTTP/1.1" 200 37898 "" "Prometheus/2.33.4" 2024-05-25T05:24:06.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:05 smithi088 ceph-mon[29649]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:06.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:05 smithi088 ceph-mon[24736]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:05 smithi136 ceph-mon[25618]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:07.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:07 smithi136 ceph-mon[25618]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:07.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:07 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:07.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:07.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:07.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[29649]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[24736]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:08.912 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:08 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:09.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[24736]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:09.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:08 smithi088 ceph-mon[29649]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:09.331 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.331 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.331 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:09.331 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:08 smithi136 ceph-mon[25618]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:12.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:11 smithi088 ceph-mon[24736]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:11 smithi088 ceph-mon[29649]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:11 smithi136 ceph-mon[25618]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:13 smithi136 ceph-mon[25618]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:13.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:13.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:14.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:13 smithi088 ceph-mon[29649]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:13 smithi088 ceph-mon[24736]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:14.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:24:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:24:14] "GET /metrics HTTP/1.1" 200 37898 "" "Prometheus/2.33.4" 2024-05-25T05:24:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:15 smithi088 ceph-mon[24736]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:15 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:15 smithi088 ceph-mon[29649]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:15 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:15 smithi136 ceph-mon[25618]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:16.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:15 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:18.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:17 smithi088 ceph-mon[24736]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:17 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:17 smithi088 ceph-mon[29649]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:17 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:17 smithi136 ceph-mon[25618]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:17 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:19.052 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:20.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:19 smithi088 ceph-mon[29649]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:19 smithi088 ceph-mon[24736]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:19 smithi136 ceph-mon[25618]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:22.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:21 smithi088 ceph-mon[24736]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:21 smithi088 ceph-mon[29649]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:21 smithi136 ceph-mon[25618]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:23.634 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:23.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:23.918 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:23 smithi088 ceph-mon[24736]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:23.918 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:23 smithi088 ceph-mon[29649]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:24.003 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:23 smithi136 ceph-mon[25618]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:24.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:24:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:24:24] "GET /metrics HTTP/1.1" 200 37899 "" "Prometheus/2.33.4" 2024-05-25T05:24:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:25 smithi088 ceph-mon[29649]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:25 smithi088 ceph-mon[24736]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:25 smithi136 ceph-mon[25618]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[29649]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[24736]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:27 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:27 smithi136 ceph-mon[25618]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:28.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:27 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:28.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:28.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:27 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.099 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:28 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:29.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:29 smithi136 ceph-mon[25618]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:29.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[24736]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:29.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:29.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:29 smithi088 ceph-mon[29649]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:30.862 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:30 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:31.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:30 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:31.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:30 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:31.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:31 smithi136 ceph-mon[25618]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:31 smithi088 ceph-mon[24736]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:31 smithi088 ceph-mon[29649]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:33.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:33 smithi136 ceph-mon[25618]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:33.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:33.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:34.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:33 smithi088 ceph-mon[24736]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:34.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:33 smithi088 ceph-mon[29649]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:34.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:24:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:24:34] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:24:36.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:35 smithi088 ceph-mon[24736]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:35 smithi088 ceph-mon[29649]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:35 smithi136 ceph-mon[25618]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:38.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[24736]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[29649]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:24:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:37 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:37 smithi136 ceph-mon[25618]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:24:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:37 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:24:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:37 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:39.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:38 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:39.036 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:39.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:38 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:39.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:38 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:40.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:39 smithi088 ceph-mon[24736]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:39 smithi088 ceph-mon[29649]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:39 smithi136 ceph-mon[25618]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:42.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:41 smithi088 ceph-mon[24736]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:41 smithi088 ceph-mon[29649]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:41 smithi136 ceph-mon[25618]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:43.850 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:43 smithi088 ceph-mon[24736]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:43.851 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:43 smithi088 ceph-mon[29649]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:43 smithi136 ceph-mon[25618]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:24:43.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:43.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:44.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:24:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:24:44] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:24:46.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:45 smithi088 ceph-mon[29649]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:46.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:45 smithi088 ceph-mon[24736]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:45 smithi136 ceph-mon[25618]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 82 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:24:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[24736]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[29649]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:47.855 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:47 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:47 smithi136 ceph-mon[25618]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:47 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.155 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch daemon redeploy "mgr.$(ceph mgr dump -f json | jq .standbys | jq .[] | jq -r .name)" --image quay.ceph.io/ceph-ci/ceph:$sha1' 2024-05-25T05:24:48.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:48.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:48.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:48.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:49.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:48 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:48.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:49.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:49 smithi088 ceph-mon[29649]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:49.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:49 smithi088 ceph-mon[24736]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:49 smithi136 ceph-mon[25618]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:50.586 INFO:teuthology.orchestra.run.smithi088.stdout:Scheduled to redeploy mgr.y on host 'smithi088' 2024-05-25T05:24:50.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3172935952' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:24:50.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:24:50.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3172935952' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:24:50.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:50 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:24:50.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:50 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3172935952' entity='client.admin' cmd=[{"prefix": "mgr dump", "format": "json"}]: dispatch 2024-05-25T05:24:50.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:50 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:50 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:50 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:50.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:50 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:24:51.258 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps --refresh' 2024-05-25T05:24:51.980 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:51 smithi088 ceph-mon[24736]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:24:51.980 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:51 smithi088 ceph-mon[24736]: Schedule redeploy daemon mgr.y 2024-05-25T05:24:51.980 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:51 smithi088 ceph-mon[24736]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:51.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:51 smithi088 ceph-mon[29649]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:24:51.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:51 smithi088 ceph-mon[29649]: Schedule redeploy daemon mgr.y 2024-05-25T05:24:51.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:51 smithi088 ceph-mon[29649]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:52.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:51 smithi136 ceph-mon[25618]: from='client.15168 -' entity='client.admin' cmd=[{"prefix": "orch daemon redeploy", "name": "mgr.y", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:24:52.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:51 smithi136 ceph-mon[25618]: Schedule redeploy daemon mgr.y 2024-05-25T05:24:52.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:51 smithi136 ceph-mon[25618]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 95 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:53.519 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:53.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:53 smithi136 ceph-mon[25618]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:24:54.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:53 smithi088 ceph-mon[24736]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:24:54.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:53 smithi088 ceph-mon[29649]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:24:54.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:24:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:24:54] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 7s ago 16m - - 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 6s ago 16m - - 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (2m) 7s ago 10m 24.8M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (2m) 6s ago 10m 43.8M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (2m) 7s ago 9m 50.8M - 3.5 e1d6a67b021e 00a4c35c3e15 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283 running (5m) 6s ago 15m 520M - 19.0.0-2843-gea0684c0 f9a9809cafd6 1d0d66e6da75 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:9283 running (17m) 7s ago 17m 410M - 17.2.0 e1d6a67b021e a93f9f434c45 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (17m) 7s ago 17m 61.1M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (15m) 6s ago 15m 44.3M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (16m) 7s ago 16m 43.4M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:24:54.913 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (3m) 7s ago 11m 16.9M - 1.3.1 1dbe0e931976 a11a34b18e29 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (2m) 6s ago 11m 19.3M - 1.3.1 1dbe0e931976 85883e864814 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (15m) 7s ago 15m 52.9M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (14m) 7s ago 14m 53.8M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (14m) 7s ago 14m 49.2M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (14m) 7s ago 14m 55.1M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (13m) 6s ago 13m 52.7M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (13m) 6s ago 13m 50.6M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (13m) 6s ago 13m 51.6M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (12m) 6s ago 12m 51.5M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (2m) 6s ago 12m 70.7M - 2.33.4 514e6a882f6e c0b59a15b0c3 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (10m) 7s ago 10m 73.0M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:24:54.914 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (10m) 6s ago 10m 74.4M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: Deploying daemon mgr.y on smithi088 2024-05-25T05:24:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[24736]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:24:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: Deploying daemon mgr.y on smithi088 2024-05-25T05:24:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:55 smithi088 ceph-mon[29649]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:24:55.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: Deploying daemon mgr.y on smithi088 2024-05-25T05:24:55.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:55 smithi136 ceph-mon[25618]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:24:55.837 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'sleep 180' 2024-05-25T05:24:56.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:56 smithi088 ceph-mon[24736]: from='client.25069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:24:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:56 smithi088 ceph-mon[29649]: from='client.25069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:24:56.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:56 smithi136 ceph-mon[25618]: from='client.25069 -' entity='client.admin' cmd=[{"prefix": "orch ps", "refresh": true, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:24:57.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:57 smithi088 systemd[1]: Stopping Ceph mgr.y for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:24:57.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:57 smithi088 ceph-mon[29649]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:24:57.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:57 smithi088 ceph-mon[24736]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:24:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:57 smithi136 ceph-mon[25618]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:24:58.179 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:58 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:58.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:58 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:58.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:58 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:24:58.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:58 smithi088 podman[70536]: 2024-05-25 05:24:58.657961553 +0000 UTC m=+1.117329750 container died a93f9f434c45fa2433ad6bdca5ab8bacad0f528ec7abebb8abe4170e3918412b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, version=8, io.buildah.version=1.19.8, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, release=754, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, vcs-type=git, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , name=centos-stream, ceph=True, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-05-25T05:24:59.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:24:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:24:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:24:59.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 podman[70536]: 2024-05-25 05:24:59.042534586 +0000 UTC m=+1.501902774 container cleanup a93f9f434c45fa2433ad6bdca5ab8bacad0f528ec7abebb8abe4170e3918412b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, CEPH_POINT_RELEASE=-17.2.0, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, io.openshift.expose-services=, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , architecture=x86_64, RELEASE=HEAD) 2024-05-25T05:24:59.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 bash[70536]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y 2024-05-25T05:24:59.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 podman[70575]: 2024-05-25 05:24:59.285746503 +0000 UTC m=+0.628313814 container remove a93f9f434c45fa2433ad6bdca5ab8bacad0f528ec7abebb8abe4170e3918412b (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, version=8, distribution-scope=public, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, GIT_CLEAN=True, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, name=centos-stream, io.buildah.version=1.19.8, architecture=x86_64, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-25T05:24:59.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:24:59.670 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service: Failed with result 'exit-code'. 2024-05-25T05:24:59.670 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 systemd[1]: Stopped Ceph mgr.y for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:24:59.670 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service: Consumed 1min 8.450s CPU time. 2024-05-25T05:24:59.670 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 systemd[1]: Starting Ceph mgr.y for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:24:59.956 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:24:59 smithi088 ceph-mon[24736]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:59.957 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:24:59 smithi088 ceph-mon[29649]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:24:59.957 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 podman[70705]: 2024-05-25 05:24:59.735687316 +0000 UTC m=+0.017452274 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:24:59.957 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:24:59 smithi088 podman[70705]: 2024-05-25 05:24:59.861855379 +0000 UTC m=+0.143620337 container create 2bd3af4bc07f072ac9ff4935ac9becf845626928c403956b13b1473e1300560d (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-ea0684c, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, ceph=True) 2024-05-25T05:25:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:24:59 smithi136 ceph-mon[25618]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:25:00.421 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 podman[70705]: 2024-05-25 05:25:00.06426439 +0000 UTC m=+0.346029340 container init 2bd3af4bc07f072ac9ff4935ac9becf845626928c403956b13b1473e1300560d (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, ceph=True, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-25T05:25:00.421 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 podman[70705]: 2024-05-25 05:25:00.067086426 +0000 UTC m=+0.348851394 container start 2bd3af4bc07f072ac9ff4935ac9becf845626928c403956b13b1473e1300560d (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.build-date=20240521) 2024-05-25T05:25:00.421 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mgr[70724]: -- 172.21.15.88:0/1809580662 <== mon.1 v2:172.21.15.88:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x5605892fa5a0 con 0x5605892cf000 2024-05-25T05:25:00.421 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 bash[70705]: 2bd3af4bc07f072ac9ff4935ac9becf845626928c403956b13b1473e1300560d 2024-05-25T05:25:00.422 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 systemd[1]: Started Ceph mgr.y for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:25:00.422 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:00.228+0000 7fef46343200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:25:00.422 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:00.420+0000 7fef46343200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:25:00.678 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:00.524+0000 7fef46343200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:25:01.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:00.838+0000 7fef46343200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:25:01.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:00 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:00.926+0000 7fef46343200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:25:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:25:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:25:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:02.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:01 smithi088 ceph-mon[29649]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:25:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:01 smithi088 ceph-mon[24736]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:25:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:01 smithi136 ceph-mon[25618]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:25:02.485 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:02.140+0000 7fef46343200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:25:02.485 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:02.313+0000 7fef46343200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:25:03.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:02.485+0000 7fef46343200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:25:03.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:02.792+0000 7fef46343200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:25:03.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:02.898+0000 7fef46343200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:25:03.443 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:03.125+0000 7fef46343200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:25:03.444 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:03.325+0000 7fef46343200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:25:03.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:03 smithi136 ceph-mon[25618]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:25:03.760 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:03.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:03.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:03 smithi088 ceph-mon[24736]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:25:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:03 smithi088 ceph-mon[29649]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 37 KiB/s rd, 0 B/s wr, 60 op/s 2024-05-25T05:25:04.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:25:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:25:04] "GET /metrics HTTP/1.1" 200 37900 "" "Prometheus/2.33.4" 2024-05-25T05:25:04.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:03.959+0000 7fef46343200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:25:04.708 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:04.411+0000 7fef46343200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:25:04.708 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:04.519+0000 7fef46343200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:25:05.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:04.734+0000 7fef46343200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:25:05.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:05.284+0000 7fef46343200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:25:05.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:05.383+0000 7fef46343200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:25:05.893 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:05 smithi088 ceph-mon[24736]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:05.893 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:05 smithi088 ceph-mon[29649]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:05.893 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:05.653+0000 7fef46343200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:25:05.893 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:05.824+0000 7fef46343200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:25:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:05 smithi136 ceph-mon[25618]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:06.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:05.932+0000 7fef46343200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:25:06.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:06.057+0000 7fef46343200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:25:06.683 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:06.424+0000 7fef46343200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:25:07.417 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:07.077+0000 7fef46343200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:25:07.418 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:07.310+0000 7fef46343200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:25:07.418 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:25:07] ENGINE Bus STARTING 2024-05-25T05:25:07.687 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: CherryPy Checker: 2024-05-25T05:25:07.688 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: The Application mounted at '' has an empty config. 2024-05-25T05:25:07.688 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:25:07.688 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:25:07] ENGINE Serving on http://:::9283 2024-05-25T05:25:07.688 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:25:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:25:07] ENGINE Bus STARTED 2024-05-25T05:25:08.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: Standby manager daemon y restarted 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: Standby manager daemon y started 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: Standby manager daemon y restarted 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: Standby manager daemon y started 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:07 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: Standby manager daemon y restarted 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: Standby manager daemon y started 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:07 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.996 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[24736]: mgrmap e26: x(active, since 3m), standbys: y 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[29649]: mgrmap e26: x(active, since 3m), standbys: y 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:08.997 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:09.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:08 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:08 smithi136 ceph-mon[25618]: mgrmap e26: x(active, since 3m), standbys: y 2024-05-25T05:25:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:09.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:08 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:08.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:09 smithi136 ceph-mon[25618]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:10.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[29649]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[24736]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:12.005 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:11 smithi136 ceph-mon[25618]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:12.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:11 smithi088 ceph-mon[29649]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:12.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:11 smithi088 ceph-mon[24736]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:13 smithi136 ceph-mon[25618]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:13.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:13.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:13 smithi088 ceph-mon[24736]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:13 smithi088 ceph-mon[29649]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:14.357 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:25:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:25:14] "GET /metrics HTTP/1.1" 200 37900 "" "Prometheus/2.33.4" 2024-05-25T05:25:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:15 smithi088 ceph-mon[24736]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:15 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:15 smithi088 ceph-mon[29649]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:15 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:15 smithi136 ceph-mon[25618]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:15 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:18.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:17 smithi088 ceph-mon[24736]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:17 smithi088 ceph-mon[29649]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:17 smithi136 ceph-mon[25618]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:19.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:18 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:18 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:18 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:19.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:18.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:19 smithi088 ceph-mon[24736]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:19 smithi088 ceph-mon[29649]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:19 smithi136 ceph-mon[25618]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:22.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:21 smithi088 ceph-mon[29649]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:21 smithi088 ceph-mon[24736]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:21 smithi136 ceph-mon[25618]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:23 smithi136 ceph-mon[25618]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:23.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:23.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:24.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:23 smithi088 ceph-mon[29649]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:23 smithi088 ceph-mon[24736]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:24.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:25:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:25:24] "GET /metrics HTTP/1.1" 200 37892 "" "Prometheus/2.33.4" 2024-05-25T05:25:26.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:25 smithi088 ceph-mon[24736]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:25 smithi088 ceph-mon[29649]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:25 smithi136 ceph-mon[25618]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:27 smithi088 ceph-mon[24736]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:27 smithi088 ceph-mon[29649]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:27 smithi136 ceph-mon[25618]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:28.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:28 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:28 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:29.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:30.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:29 smithi088 ceph-mon[24736]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:29 smithi088 ceph-mon[29649]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:29 smithi136 ceph-mon[25618]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:31.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:30 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:31.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:30 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:30 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:31.985 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:31 smithi136 ceph-mon[25618]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:32.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:31 smithi088 ceph-mon[24736]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:31 smithi088 ceph-mon[29649]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:33.782 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:33 smithi136 ceph-mon[25618]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:33.782 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:33.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:34.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:33 smithi088 ceph-mon[24736]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:34.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:33 smithi088 ceph-mon[29649]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:34.088 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:25:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:25:34] "GET /metrics HTTP/1.1" 200 37899 "" "Prometheus/2.33.4" 2024-05-25T05:25:36.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:35 smithi088 ceph-mon[24736]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:36.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:35 smithi088 ceph-mon[29649]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:35 smithi136 ceph-mon[25618]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:38.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:37 smithi088 ceph-mon[24736]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:37 smithi088 ceph-mon[29649]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:37 smithi136 ceph-mon[25618]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:39.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:38 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:39.036 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:38.659Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:39.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:38 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:39.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:38 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:40.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:39 smithi088 ceph-mon[24736]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:39 smithi088 ceph-mon[29649]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:39 smithi136 ceph-mon[25618]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:42.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:41 smithi088 ceph-mon[24736]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:41 smithi088 ceph-mon[29649]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:41 smithi136 ceph-mon[25618]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:43.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:43 smithi136 ceph-mon[25618]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:43.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:43.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:44.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:43 smithi088 ceph-mon[24736]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:43 smithi088 ceph-mon[29649]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:44.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:25:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:25:44] "GET /metrics HTTP/1.1" 200 37899 "" "Prometheus/2.33.4" 2024-05-25T05:25:46.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:45 smithi088 ceph-mon[24736]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:45 smithi088 ceph-mon[29649]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:45 smithi136 ceph-mon[25618]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:25:48.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:47 smithi088 ceph-mon[24736]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:47 smithi088 ceph-mon[29649]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:47 smithi136 ceph-mon[25618]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:48 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:25:49.136 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:50.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:49 smithi088 ceph-mon[29649]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:49 smithi088 ceph-mon[24736]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:49 smithi136 ceph-mon[25618]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:52.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:51 smithi088 ceph-mon[24736]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:51 smithi088 ceph-mon[29649]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:51 smithi136 ceph-mon[25618]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:25:53.763 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:53.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:25:54.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:53 smithi088 ceph-mon[24736]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:53 smithi088 ceph-mon[29649]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:54.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:53 smithi136 ceph-mon[25618]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:54.099 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:25:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:25:54] "GET /metrics HTTP/1.1" 200 37898 "" "Prometheus/2.33.4" 2024-05-25T05:25:56.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:55 smithi088 ceph-mon[24736]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:56.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:55 smithi088 ceph-mon[29649]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:55 smithi136 ceph-mon[25618]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:25:58.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:57 smithi088 ceph-mon[24736]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:57 smithi088 ceph-mon[29649]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:57 smithi136 ceph-mon[25618]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:25:59.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:58 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:58 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:58 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:25:59.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:25:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:25:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:00.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:25:59 smithi088 ceph-mon[24736]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:00.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:25:59 smithi088 ceph-mon[29649]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:25:59 smithi136 ceph-mon[25618]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:01.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[29649]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:00 smithi088 ceph-mon[24736]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:26:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:26:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:26:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:00 smithi136 ceph-mon[25618]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:03.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:03 smithi136 ceph-mon[25618]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:03.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:03.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:04.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:03 smithi088 ceph-mon[29649]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:04.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:03 smithi088 ceph-mon[24736]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:04.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:26:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:26:04] "GET /metrics HTTP/1.1" 200 37901 "" "Prometheus/2.33.4" 2024-05-25T05:26:06.027 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:05 smithi088 ceph-mon[24736]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:06.028 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:05 smithi088 ceph-mon[29649]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:05 smithi136 ceph-mon[25618]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:07 smithi088 ceph-mon[24736]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:07 smithi088 ceph-mon[29649]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:07 smithi136 ceph-mon[25618]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:09.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:08 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:09.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:08 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.036 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:08 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:09.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:09.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:08 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.048 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:09 smithi136 ceph-mon[25618]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:10.048 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.048 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.048 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[24736]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[29649]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:12.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:11 smithi088 ceph-mon[29649]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:12.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:11 smithi088 ceph-mon[24736]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:12.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:11 smithi136 ceph-mon[25618]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:13.730 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:13.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:14.002 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:13 smithi136 ceph-mon[25618]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:14.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:13 smithi088 ceph-mon[29649]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:13 smithi088 ceph-mon[24736]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:14.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:26:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:26:14] "GET /metrics HTTP/1.1" 200 37901 "" "Prometheus/2.33.4" 2024-05-25T05:26:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:15 smithi088 ceph-mon[24736]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:15 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:15 smithi088 ceph-mon[29649]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:15 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:15 smithi136 ceph-mon[25618]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:15 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:18.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:17 smithi088 ceph-mon[29649]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:17 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:17 smithi088 ceph-mon[24736]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:17 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:17 smithi136 ceph-mon[25618]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:17 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:19.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:18.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:19 smithi088 ceph-mon[24736]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:19 smithi088 ceph-mon[29649]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:19 smithi136 ceph-mon[25618]: pgmap v148: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:22.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:21 smithi088 ceph-mon[29649]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:21 smithi088 ceph-mon[24736]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:21 smithi136 ceph-mon[25618]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:23.756 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:23.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:24.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:23 smithi088 ceph-mon[29649]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:23 smithi088 ceph-mon[24736]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:24.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:23 smithi136 ceph-mon[25618]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:24.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:26:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:26:24] "GET /metrics HTTP/1.1" 200 37901 "" "Prometheus/2.33.4" 2024-05-25T05:26:26.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:25 smithi088 ceph-mon[24736]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:26.041 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:25 smithi088 ceph-mon[29649]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:25 smithi136 ceph-mon[25618]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:27.918 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:27 smithi088 ceph-mon[24736]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:27.918 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:27 smithi088 ceph-mon[29649]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:27 smithi136 ceph-mon[25618]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:28.913 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:28 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:28.913 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:28.913 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:28.913 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:28 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:28.914 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:28 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:28.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:29.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:29.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:29.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:29.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:29.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:29.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:28 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[29649]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[24736]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:29 smithi136 ceph-mon[25618]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:31.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:30 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:31.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:30 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:30 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:32.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:31 smithi088 ceph-mon[29649]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:31 smithi088 ceph-mon[24736]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:31 smithi136 ceph-mon[25618]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:33.777 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:33.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:34.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:33 smithi088 ceph-mon[29649]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:33 smithi088 ceph-mon[24736]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:33 smithi136 ceph-mon[25618]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:34.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:26:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:26:34] "GET /metrics HTTP/1.1" 200 37894 "" "Prometheus/2.33.4" 2024-05-25T05:26:35.010 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:34 smithi136 ceph-mon[25618]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:35.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:34 smithi088 ceph-mon[24736]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:35.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:34 smithi088 ceph-mon[29649]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:37.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:37 smithi136 ceph-mon[25618]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:38.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:37 smithi088 ceph-mon[24736]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:37 smithi088 ceph-mon[29649]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:39.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:38 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:39.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:38 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:39.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:38 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:39.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:38.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:40.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:39 smithi136 ceph-mon[25618]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:40.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:39 smithi088 ceph-mon[24736]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:39 smithi088 ceph-mon[29649]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:41 smithi088 ceph-mon[24736]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:41 smithi088 ceph-mon[29649]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:41 smithi136 ceph-mon[25618]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:43.766 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:43.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:44.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:43 smithi088 ceph-mon[24736]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:43 smithi088 ceph-mon[29649]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:44.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:43 smithi136 ceph-mon[25618]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:44.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:26:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:26:44] "GET /metrics HTTP/1.1" 200 37894 "" "Prometheus/2.33.4" 2024-05-25T05:26:46.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:45 smithi088 ceph-mon[29649]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:45 smithi088 ceph-mon[24736]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:45 smithi136 ceph-mon[25618]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:26:47.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:47 smithi136 ceph-mon[25618]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:48.026 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:47 smithi088 ceph-mon[24736]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:48.027 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:47 smithi088 ceph-mon[29649]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:49.044 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:48 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:49.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.045 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:48 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.045 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:48.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:49.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:49.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:49.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:48 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[24736]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[29649]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:49 smithi136 ceph-mon[25618]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:26:52.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:51 smithi088 ceph-mon[29649]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:52.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:51 smithi088 ceph-mon[24736]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:51 smithi136 ceph-mon[25618]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:53.781 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:53.506Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:26:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:53 smithi088 ceph-mon[24736]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:53 smithi088 ceph-mon[29649]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:53 smithi136 ceph-mon[25618]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:54.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:26:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:26:54] "GET /metrics HTTP/1.1" 200 37884 "" "Prometheus/2.33.4" 2024-05-25T05:26:54.998 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:54 smithi136 ceph-mon[25618]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:55.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:54 smithi088 ceph-mon[24736]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:55.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:54 smithi088 ceph-mon[29649]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:26:58.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:57 smithi088 ceph-mon[29649]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:57 smithi088 ceph-mon[24736]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:57 smithi136 ceph-mon[25618]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:26:59.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:58 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:58 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:58 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:26:59.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:26:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:26:58.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:27:00.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:26:59 smithi088 ceph-mon[24736]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:00.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:26:59 smithi088 ceph-mon[29649]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:26:59 smithi136 ceph-mon[25618]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:01.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:27:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:27:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:27:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:27:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:01 smithi088 ceph-mon[24736]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:01 smithi088 ceph-mon[29649]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:01 smithi136 ceph-mon[25618]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:03.778 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:27:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:27:03.505Z caller=manager.go:609 level=warn component="rule manager" group=nodes msg="Evaluating rule failed" rule="alert: CephNodeDiskspaceWarning\nexpr: predict_linear(node_filesystem_free_bytes{device=~\"/.*\"}[2d], 3600 * 24 * 5)\n * on(instance) group_left(nodename) node_uname_info < 0\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.8.4\n severity: warning\n type: ceph_default\nannotations:\n description: Mountpoint {{ $labels.mountpoint }} on {{ $labels.nodename }} will\n be full in less than 5 days based on the 48 hour trailing fill rate.\n summary: Host filesystem free space is getting low\n" err="found duplicate series for the match group {instance=\"smithi088\"} on the right hand-side of the operation: [{__name__=\"node_uname_info\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}, {__name__=\"node_uname_info\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", domainname=\"(none)\", instance=\"smithi088\", job=\"node\", machine=\"x86_64\", nodename=\"smithi088\", release=\"5.14.0-447.el9.x86_64\", sysname=\"Linux\", version=\"#1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:27:04.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:03 smithi088 ceph-mon[29649]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:04.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:03 smithi088 ceph-mon[24736]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:03 smithi136 ceph-mon[25618]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:04.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:27:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:27:04] "GET /metrics HTTP/1.1" 200 37897 "" "Prometheus/2.33.4" 2024-05-25T05:27:06.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:05 smithi088 ceph-mon[29649]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:06.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:05 smithi088 ceph-mon[24736]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:05 smithi136 ceph-mon[25618]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:08.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:07 smithi088 ceph-mon[29649]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:07 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:07 smithi088 ceph-mon[24736]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:08.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:07 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:07 smithi136 ceph-mon[25618]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:07 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:09.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:27:08 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:27:08.660Z caller=manager.go:609 level=warn component="rule manager" group=osd msg="Evaluating rule failed" rule="alert: CephOSDFlapping\nexpr: (rate(ceph_osd_up[5m]) * on(ceph_daemon) group_left(hostname) ceph_osd_metadata)\n * 60 > 1\nlabels:\n oid: 1.3.6.1.4.1.50495.1.2.1.4.4\n severity: warning\n type: ceph_default\nannotations:\n description: OSD {{ $labels.ceph_daemon }} on {{ $labels.hostname }} was marked\n down and back up {{ $value | humanize }} times once a minute for 5 minutes. This\n may indicate a network issue (latency, packet loss, MTU mismatch) on the cluster\n network, or the public network if no cluster network is deployed. Check the network\n stats on the listed host(s).\n documentation: https://docs.ceph.com/en/latest/rados/troubleshooting/troubleshooting-osd#flapping-osds\n summary: Network issues are causing OSDs to flap (mark each other down)\n" err="found duplicate series for the match group {ceph_daemon=\"osd.0\"} on the right hand-side of the operation: [{__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"172.21.15.136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}, {__name__=\"ceph_osd_metadata\", ceph_daemon=\"osd.0\", ceph_version=\"ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)\", cluster=\"9a885618-1a54-11ef-bc9b-c7b262605968\", cluster_addr=\"172.21.15.88\", device_class=\"ssd\", hostname=\"smithi088\", instance=\"smithi136:9283\", job=\"ceph\", objectstore=\"bluestore\", public_addr=\"172.21.15.88\"}];many-to-many matching not allowed: matching labels must be unique on one side" 2024-05-25T05:27:09.962 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[29649]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[24736]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.964 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.964 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:09.964 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:09 smithi136 ceph-mon[25618]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:12.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:11 smithi088 ceph-mon[24736]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:11 smithi088 ceph-mon[29649]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:11 smithi136 ceph-mon[25618]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:14.003 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:13 smithi136 ceph-mon[25618]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:13 smithi088 ceph-mon[24736]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:13 smithi088 ceph-mon[29649]: pgmap v175: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:14.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:27:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:27:14] "GET /metrics HTTP/1.1" 200 37897 "" "Prometheus/2.33.4" 2024-05-25T05:27:15.969 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:15 smithi136 ceph-mon[25618]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:15.969 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:15 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:15 smithi088 ceph-mon[24736]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:15 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:15 smithi088 ceph-mon[29649]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:15 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:17.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:17 smithi136 ceph-mon[25618]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:18.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:17 smithi088 ceph-mon[29649]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:18.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:17 smithi088 ceph-mon[24736]: pgmap v177: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:18 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:19.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:18 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:19.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:18 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:19 smithi088 ceph-mon[24736]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:19 smithi088 ceph-mon[29649]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:19 smithi136 ceph-mon[25618]: pgmap v178: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:21 smithi088 ceph-mon[29649]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:21 smithi088 ceph-mon[24736]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:21 smithi136 ceph-mon[25618]: pgmap v179: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:24.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:23 smithi088 ceph-mon[24736]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:24.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:23 smithi088 ceph-mon[29649]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:23 smithi136 ceph-mon[25618]: pgmap v180: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:24.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:27:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:27:24] "GET /metrics HTTP/1.1" 200 37898 "" "Prometheus/2.33.4" 2024-05-25T05:27:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:25 smithi088 ceph-mon[29649]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:25 smithi088 ceph-mon[24736]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:25 smithi136 ceph-mon[25618]: pgmap v181: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:27 smithi088 ceph-mon[24736]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:28.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:27 smithi088 ceph-mon[29649]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:27 smithi136 ceph-mon[25618]: pgmap v182: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:28 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:28 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:29.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:28 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[29649]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[24736]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:30.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:29 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:29 smithi136 ceph-mon[25618]: pgmap v183: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:29 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:31.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:30 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:30 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:30 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:32.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:31 smithi088 ceph-mon[29649]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:31 smithi088 ceph-mon[24736]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:31 smithi136 ceph-mon[25618]: pgmap v184: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:34.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:33 smithi088 ceph-mon[29649]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:33 smithi088 ceph-mon[24736]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:33 smithi136 ceph-mon[25618]: pgmap v185: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:34.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:27:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:27:34] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:27:35.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:34 smithi088 ceph-mon[29649]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:35.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:34 smithi088 ceph-mon[24736]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:35.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:34 smithi136 ceph-mon[25618]: pgmap v186: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:38.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:37 smithi088 ceph-mon[29649]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:37 smithi088 ceph-mon[24736]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:38.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:37 smithi136 ceph-mon[25618]: pgmap v187: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:39.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:38 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:39.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:38 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:39.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:38 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:40.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:39 smithi136 ceph-mon[25618]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:40.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:39 smithi088 ceph-mon[24736]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:40.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:39 smithi088 ceph-mon[29649]: pgmap v188: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:42.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:41 smithi088 ceph-mon[29649]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:41 smithi088 ceph-mon[24736]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:41 smithi136 ceph-mon[25618]: pgmap v189: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:44.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:43 smithi088 ceph-mon[29649]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:43 smithi088 ceph-mon[24736]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:44.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:43 smithi136 ceph-mon[25618]: pgmap v190: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:44.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:27:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:27:44] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:27:45.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:45 smithi136 ceph-mon[25618]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:45.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:45 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:46.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:45 smithi088 ceph-mon[29649]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:45 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:45 smithi088 ceph-mon[24736]: pgmap v191: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:45 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:27:48.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:47 smithi088 ceph-mon[24736]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:48.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:47 smithi088 ceph-mon[29649]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:47 smithi136 ceph-mon[25618]: pgmap v192: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:49.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:48 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:49.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:48 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:49.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:48 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[24736]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[29649]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:50.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:49 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:49 smithi136 ceph-mon[25618]: pgmap v193: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:49 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:27:50.883 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:50 smithi088 ceph-mon[24736]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:50.884 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:50 smithi088 ceph-mon[29649]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:51.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:50 smithi136 ceph-mon[25618]: pgmap v194: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:53 smithi088 ceph-mon[24736]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:53 smithi088 ceph-mon[29649]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:53 smithi136 ceph-mon[25618]: pgmap v195: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:54.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:27:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:27:54] "GET /metrics HTTP/1.1" 200 37898 "" "Prometheus/2.33.4" 2024-05-25T05:27:56.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:55 smithi088 ceph-mon[24736]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:56.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:55 smithi088 ceph-mon[29649]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:55 smithi136 ceph-mon[25618]: pgmap v196: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:58.020 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:57 smithi136 ceph-mon[25618]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:58.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:57 smithi088 ceph-mon[24736]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:57 smithi088 ceph-mon[29649]: pgmap v197: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:27:58.913 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:58 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:58.913 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:58 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:58.943 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:27:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:58 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:27:59.910 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:27:59 smithi088 ceph-mon[24736]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:27:59.910 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:27:59 smithi088 ceph-mon[29649]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:27:59 smithi136 ceph-mon[25618]: pgmap v198: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:00.885 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:28:00.885 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 11s ago 19m - - 2024-05-25T05:28:00.885 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 11s ago 19m - - 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (6m) 11s ago 14m 22.7M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (5m) 11s ago 13m 54.3M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (5m) 11s ago 13m 55.7M - 3.5 e1d6a67b021e 00a4c35c3e15 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283 running (8m) 11s ago 18m 526M - 19.0.0-2843-gea0684c0 f9a9809cafd6 1d0d66e6da75 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (3m) 11s ago 20m 450M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (20m) 11s ago 20m 68.6M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (18m) 11s ago 18m 50.2M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (19m) 11s ago 19m 49.5M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (6m) 11s ago 14m 18.6M - 1.3.1 1dbe0e931976 a11a34b18e29 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (5m) 11s ago 14m 18.6M - 1.3.1 1dbe0e931976 85883e864814 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (18m) 11s ago 18m 52.9M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (18m) 11s ago 18m 53.9M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:28:00.886 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (17m) 11s ago 17m 49.2M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (17m) 11s ago 17m 55.4M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (16m) 11s ago 16m 53.5M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (16m) 11s ago 16m 50.5M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (16m) 11s ago 16m 52.0M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (15m) 11s ago 15m 52.8M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (5m) 11s ago 15m 72.9M - 2.33.4 514e6a882f6e c0b59a15b0c3 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (13m) 11s ago 13m 74.3M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:28:00.887 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (13m) 11s ago 13m 75.6M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[29649]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[24736]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:01.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:00 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:00 smithi136 ceph-mon[25618]: from='mgr.24809 172.21.15.136:0/1005238371' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:00 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:01.536 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions' 2024-05-25T05:28:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:01 smithi088 ceph-mon[29649]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:01 smithi088 ceph-mon[29649]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:28:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:01 smithi088 ceph-mon[24736]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:01 smithi088 ceph-mon[24736]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:28:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:01 smithi136 ceph-mon[25618]: pgmap v199: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:01 smithi136 ceph-mon[25618]: from='client.15186 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:28:02.846 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:02 smithi088 ceph-mon[24736]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:02.846 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:02 smithi088 ceph-mon[29649]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:03.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:02 smithi136 ceph-mon[25618]: pgmap v200: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:28:03.520 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:28:03.521 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:28:04.106 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:03 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1793261579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:28:04.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:03 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1793261579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:28:04.130 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph health detail' 2024-05-25T05:28:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:03 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1793261579' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:28:04.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:28:04] "GET /metrics HTTP/1.1" 200 37896 "" "Prometheus/2.33.4" 2024-05-25T05:28:05.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:04 smithi088 ceph-mon[24736]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:04 smithi088 ceph-mon[29649]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:04 smithi136 ceph-mon[25618]: pgmap v201: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:06.234 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2024-05-25T05:28:06.544 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:06 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1107504345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:28:06.544 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:06 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1107504345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:28:06.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:06 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1107504345' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:28:06.940 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph -s' 2024-05-25T05:28:07.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:07 smithi088 ceph-mon[29649]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:07.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:07 smithi088 ceph-mon[24736]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:07.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:07 smithi136 ceph-mon[25618]: pgmap v202: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:08.465 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:08 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:08.465 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:08 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:08.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:08 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:08.956 INFO:teuthology.orchestra.run.smithi088.stdout: cluster: 2024-05-25T05:28:08.956 INFO:teuthology.orchestra.run.smithi088.stdout: id: 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:28:08.956 INFO:teuthology.orchestra.run.smithi088.stdout: health: HEALTH_OK 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: services: 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: mon: 3 daemons, quorum a,c,b (age 19m) 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: mgr: x(active, since 6m), standbys: y 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: osd: 8 osds: 8 up (since 15m), 8 in (since 16m) 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: data: 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: pools: 6 pools, 161 pgs 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: objects: 241 objects, 585 KiB 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: usage: 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: pgs: 161 active+clean 2024-05-25T05:28:08.957 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:28:08.958 INFO:teuthology.orchestra.run.smithi088.stdout: io: 2024-05-25T05:28:08.958 INFO:teuthology.orchestra.run.smithi088.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-05-25T05:28:08.958 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:28:09.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph mgr fail' 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/454457289' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[24736]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/454457289' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:09 smithi088 ceph-mon[29649]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: pgmap v203: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/454457289' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:28:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:09 smithi136 ceph-mon[25618]: from='mgr.24809 ' entity='mgr.x' 2024-05-25T05:28:11.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:11 smithi088 ceph-mon[29649]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:11.940 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:11 smithi088 ceph-mon[24736]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:11 smithi136 ceph-mon[25618]: pgmap v204: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:12.833 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:12 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/4015039604' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:28:12.833 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:12 smithi088 ceph-mon[29649]: osdmap e105: 8 total, 8 up, 8 in 2024-05-25T05:28:12.833 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:12 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/4015039604' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:28:12.833 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:12 smithi088 ceph-mon[24736]: osdmap e105: 8 total, 8 up, 8 in 2024-05-25T05:28:12.834 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:12 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:28:12] ENGINE Bus STOPPING 2024-05-25T05:28:12.834 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:12 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:28:12] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:28:12.834 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:12 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:28:12] ENGINE Bus STOPPED 2024-05-25T05:28:13.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:12 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/4015039604' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:28:13.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:12 smithi136 ceph-mon[25618]: osdmap e105: 8 total, 8 up, 8 in 2024-05-25T05:28:13.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:12.793+0000 7f777b92e700 -1 mgr handle_mgr_map I was active but no longer am 2024-05-25T05:28:13.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ignoring --setuser ceph since I am not root 2024-05-25T05:28:13.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ignoring --setgroup ceph since I am not root 2024-05-25T05:28:13.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:12 smithi136 ceph-mgr[50348]: -- 172.21.15.136:0/1070495813 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55782c7ec5a0 con 0x55782c7c0c00 2024-05-25T05:28:13.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:12.982+0000 7fac9c3e7200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:28:13.152 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:12 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:28:12] ENGINE Bus STARTING 2024-05-25T05:28:13.152 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:28:13] ENGINE Serving on http://:::9283 2024-05-25T05:28:13.153 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:28:13] ENGINE Bus STARTED 2024-05-25T05:28:13.455 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'sleep 180' 2024-05-25T05:28:13.586 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:13.167+0000 7fac9c3e7200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:28:13.586 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:13.273+0000 7fac9c3e7200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:28:13.586 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:13.584+0000 7fac9c3e7200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:28:13.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:13.671+0000 7fac9c3e7200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/4015039604' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: mgrmap e27: y(active, starting, since 0.167004s) 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:28:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: Manager daemon y is now available 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:13.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-25T05:28:13.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/4015039604' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:28:13.988 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: mgrmap e27: y(active, starting, since 0.167004s) 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:28:13.989 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: Manager daemon y is now available 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:13.990 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: pgmap v206: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 0 op/s 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/4015039604' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: mgrmap e27: y(active, starting, since 0.167004s) 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:28:13.991 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: Manager daemon y is now available 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:28:13.992 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:28:13.993 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:28:13.993 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:28:13.993 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:13.993 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:14.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: [25/May/2024:05:28:13] ENGINE Bus STARTING 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: [25/May/2024:05:28:13] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: mgrmap e28: y(active, since 1.18129s) 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: [25/May/2024:05:28:13] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: [25/May/2024:05:28:13] ENGINE Bus STARTED 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:14.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: [25/May/2024:05:28:13] ENGINE Bus STARTING 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: [25/May/2024:05:28:13] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: mgrmap e28: y(active, since 1.18129s) 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: [25/May/2024:05:28:13] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: [25/May/2024:05:28:13] ENGINE Bus STARTED 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:28:14.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:14.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:14.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:14 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:15.121 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:14.927+0000 7fac9c3e7200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:28:15.121 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:28:15.121 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:28:15.121 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: [25/May/2024:05:28:13] ENGINE Bus STARTING 2024-05-25T05:28:15.121 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: [25/May/2024:05:28:13] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: mgrmap e28: y(active, since 1.18129s) 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: [25/May/2024:05:28:13] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: [25/May/2024:05:28:13] ENGINE Bus STARTED 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:15.122 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:14 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:15.378 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:15.120+0000 7fac9c3e7200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:28:15.378 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:15.301+0000 7fac9c3e7200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:28:15.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:15.601+0000 7fac9c3e7200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:15.696+0000 7fac9c3e7200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:15 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:15.904+0000 7fac9c3e7200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:16.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.105 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:15 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:28:16.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:28:16.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:28:16.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:28:16.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:16.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.106 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.108 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:15 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:16.364 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:16.102+0000 7fac9c3e7200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:28:16.629 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:16.432Z caller=refresh.go:98 level=error component="discovery manager notify" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.136:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.136:8765: connect: connection refused" 2024-05-25T05:28:16.630 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:16.432Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.136:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.136:8765: connect: connection refused" 2024-05-25T05:28:16.630 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:16.433Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.136:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.136:8765: connect: connection refused" 2024-05-25T05:28:16.630 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:16.434Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.136:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.136:8765: connect: connection refused" 2024-05-25T05:28:16.630 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:16.434Z caller=refresh.go:98 level=error component="discovery manager scrape" discovery=http msg="Unable to refresh target groups" err="Get \"http://172.21.15.136:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.136:8765: connect: connection refused" 2024-05-25T05:28:16.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:16 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:16.748+0000 7fac9c3e7200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:17 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:17.248+0000 7fac9c3e7200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:17 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:17.357+0000 7fac9c3e7200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: mgrmap e29: y(active, since 3s) 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:17.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:17 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: mgrmap e29: y(active, since 3s) 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.518 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: mgrmap e29: y(active, since 3s) 2024-05-25T05:28:17.519 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.519 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.519 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:17.519 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: from='client.15150 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:17.519 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.519 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.519 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:17 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:17.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:17 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:17.573+0000 7fac9c3e7200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:28:18.332 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:18.119+0000 7fac9c3e7200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:28:18.332 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:18.216+0000 7fac9c3e7200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:28:18.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:18 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:18 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:18 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:18 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:18 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:18 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:18 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:18 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.627 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:18 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:18.628 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:18.491+0000 7fac9c3e7200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:28:18.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:18.630+0000 7fac9c3e7200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:28:18.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:18.733+0000 7fac9c3e7200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:28:18.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:18.854+0000 7fac9c3e7200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:28:19.330 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:19 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:19.162+0000 7fac9c3e7200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:28:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:19 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:19 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:19 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:19 smithi136 ceph-mon[25618]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[24736]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:19.738 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:19 smithi088 ceph-mon[29649]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:28:20.024 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:19 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:19.789+0000 7fac9c3e7200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:28:19.820+0000 7feecbe89700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Creating ceph-iscsi config... 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:20.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return _run_code(code, main_globals, None, 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: exec(code, run_globals) 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:20.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return future.result(timeout) 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:28:20.059 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return self.__get_result() 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: raise self._exception 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: use_current_daemon_image=reconfig, 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Creating ceph-iscsi config... 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:28:20.060 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return _run_code(code, main_globals, None, 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: exec(code, run_globals) 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.061 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:20.023+0000 7fac9c3e7200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:28:20.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:28:20] ENGINE Bus STARTING 2024-05-25T05:28:20.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: CherryPy Checker: 2024-05-25T05:28:20.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: The Application mounted at '' has an empty config. 2024-05-25T05:28:20.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:28:20.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:28:20] ENGINE Serving on http://:::9283 2024-05-25T05:28:20.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:28:20] ENGINE Bus STARTED 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:28:20.870 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:28:20.871 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: return future.result(timeout) 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.__get_result() 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: raise self._exception 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:28:20.872 INFO:journalctl@ceph.mon.a.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:20.873 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:20.874 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:28:20.875 INFO:journalctl@ceph.mon.c.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: return future.result(timeout) 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.__get_result() 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: raise self._exception 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:20.876 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:20.877 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:28:20.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[24736]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:28:20.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:20 smithi088 ceph-mon[29649]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:21.072 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:28:21.073 INFO:journalctl@ceph.mon.b.smithi136.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: return future.result(timeout) 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.__get_result() 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: raise self._exception 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:28:21.074 INFO:journalctl@ceph.mon.b.smithi136.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:28:21.075 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:28:21.076 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:20 smithi136 ceph-mon[25618]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: mgrmap e30: y(active, since 8s), standbys: x 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.799 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: mgrmap e30: y(active, since 8s), standbys: x 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:21.800 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: mgrmap e30: y(active, since 8s), standbys: x 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:24.004 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:23 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:28:24.004 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:23 smithi136 bash[62104]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:28:24.004 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:23 smithi136 ceph-mon[25618]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:28:24.051 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:23 smithi088 ceph-mon[24736]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:28:24.051 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:23 smithi088 ceph-mon[29649]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 24 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:28:24.334 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:28:24] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:28:24.334 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[54640]: ts=2024-05-25T05:28:24.034Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-25T05:28:24.335 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 podman[62116]: 2024-05-25 05:28:24.044550281 +0000 UTC m=+0.139346454 container died c0b59a15b0c34bea8c11524a92a1eaed618a99b36384032a89a1712d4d13b0d6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:28:24.586 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 podman[62116]: 2024-05-25 05:28:24.3670351 +0000 UTC m=+0.461831265 container cleanup c0b59a15b0c34bea8c11524a92a1eaed618a99b36384032a89a1712d4d13b0d6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:28:24.587 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 bash[62116]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:28:24.587 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 bash[62142]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:28:24.587 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 podman[62128]: 2024-05-25 05:28:24.5850683 +0000 UTC m=+0.543002116 container remove c0b59a15b0c34bea8c11524a92a1eaed618a99b36384032a89a1712d4d13b0d6 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:28:24.587 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-25T05:28:24.843 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 systemd[1]: Stopped Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:28:24.844 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Consumed 1.803s CPU time. 2024-05-25T05:28:24.844 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 systemd[1]: Starting Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:28:24.844 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 podman[62205]: 2024-05-25 05:28:24.721269972 +0000 UTC m=+0.018112317 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-25T05:28:25.104 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:24 smithi136 podman[62205]: 2024-05-25 05:28:24.844634152 +0000 UTC m=+0.141476489 container create f822abe302751789e49123a3a395802165238d713d7dccca18dd5aa00edebf90 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:28:25.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 podman[62205]: 2024-05-25 05:28:25.105399414 +0000 UTC m=+0.402241753 container init f822abe302751789e49123a3a395802165238d713d7dccca18dd5aa00edebf90 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:28:25.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 podman[62205]: 2024-05-25 05:28:25.10814844 +0000 UTC m=+0.404990784 container start f822abe302751789e49123a3a395802165238d713d7dccca18dd5aa00edebf90 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.132Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.132Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.132Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.132Z caller=main.go:518 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.132Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.132Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.133Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.134Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.134Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.137Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.137Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=2.047µs 2024-05-25T05:28:25.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.137Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:28:25.388 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.138Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=3 2024-05-25T05:28:25.388 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 bash[62205]: f822abe302751789e49123a3a395802165238d713d7dccca18dd5aa00edebf90 2024-05-25T05:28:25.388 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:28:25.875 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.633Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=3 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:28:25.875 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:25.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:25.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:25.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:25.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:28:25.876 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:25 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:26.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:28:26.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:28:26.011 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:28:26.012 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:25 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:26.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.875Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=3 2024-05-25T05:28:26.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.876Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=3 2024-05-25T05:28:26.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.876Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=30.884µs wal_replay_duration=738.717184ms total_replay_duration=738.761066ms 2024-05-25T05:28:26.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.880Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:28:26.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.880Z caller=main.go:947 level=info msg="TSDB started" 2024-05-25T05:28:26.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.880Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:28:26.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.902Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=22.080054ms db_storage=684ns remote_storage=1.281µs web_handler=389ns query_engine=609ns scrape=276.01µs scrape_sd=93.803µs notify=10.858µs notify_sd=9.722µs rules=21.377129ms 2024-05-25T05:28:26.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:28:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:28:25.902Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-25T05:28:26.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:26 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:28:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:26 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:28:26.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:26 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:28:27.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:26 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:28:27.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:26 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:28:27.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:26 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:28:27.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:26 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:28:27.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:26 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:28:27.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:26 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:28:27.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:27 smithi088 ceph-mon[24736]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:27.695 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:27 smithi088 ceph-mon[29649]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:27.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:27 smithi136 ceph-mon[25618]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:28.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:28:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:28:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:28:28.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:28:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:28:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[29649]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/586074195' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:28:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:28:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:28:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[24736]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:30.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:29 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/586074195' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:28:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:29 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:28:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:29 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:28:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:29 smithi136 ceph-mon[25618]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:29 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/586074195' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:28:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:31 smithi136 ceph-mon[25618]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:32.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:31 smithi088 ceph-mon[24736]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:31 smithi088 ceph-mon[29649]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:28:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:33 smithi136 ceph-mon[25618]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-05-25T05:28:34.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:33 smithi088 ceph-mon[24736]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-05-25T05:28:34.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:33 smithi088 ceph-mon[29649]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 85 B/s rd, 0 op/s 2024-05-25T05:28:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:28:34] "GET /metrics HTTP/1.1" 200 37906 "" "Prometheus/2.33.4" 2024-05-25T05:28:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:35 smithi136 ceph-mon[25618]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:36.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:35 smithi088 ceph-mon[24736]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:36.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:35 smithi088 ceph-mon[29649]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:38.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:37 smithi088 ceph-mon[29649]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:38.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:37 smithi088 ceph-mon[24736]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:37 smithi136 ceph-mon[25618]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:39.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:39 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:39.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:39 smithi088 ceph-mon[29649]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:39.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:39 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:39.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:39 smithi088 ceph-mon[24736]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:39.874 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:39 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:39.874 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:39 smithi136 ceph-mon[25618]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 511 B/s rd, 0 op/s 2024-05-25T05:28:42.075 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[29649]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-05-25T05:28:42.076 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.076 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.076 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.076 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[24736]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-05-25T05:28:42.076 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.076 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.076 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:41 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:41 smithi136 ceph-mon[25618]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 938 B/s rd, 0 op/s 2024-05-25T05:28:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:41 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:41 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:42.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:41 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:44.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:28:44.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:28:44] "GET /metrics HTTP/1.1" 200 37906 "" "Prometheus/2.33.4" 2024-05-25T05:28:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:45 smithi136 ceph-mon[25618]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:46.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:45 smithi088 ceph-mon[24736]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:46.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:45 smithi088 ceph-mon[29649]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:47 smithi136 ceph-mon[25618]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:48.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:47 smithi088 ceph-mon[29649]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:47 smithi088 ceph-mon[24736]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:50.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:49 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:49 smithi088 ceph-mon[24736]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:49 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:49 smithi088 ceph-mon[29649]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:49 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:49 smithi136 ceph-mon[25618]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:52.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:51 smithi136 ceph-mon[25618]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:52.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:51 smithi088 ceph-mon[24736]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:52.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:51 smithi088 ceph-mon[29649]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:54.133 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:53 smithi088 ceph-mon[24736]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:54.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:53 smithi088 ceph-mon[29649]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:53 smithi136 ceph-mon[25618]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:54.537 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:28:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:28:54] "GET /metrics HTTP/1.1" 200 37906 "" "Prometheus/2.33.4" 2024-05-25T05:28:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:55 smithi136 ceph-mon[25618]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:56.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:55 smithi088 ceph-mon[24736]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:55 smithi088 ceph-mon[29649]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:28:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:57 smithi136 ceph-mon[25618]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:58.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:57 smithi088 ceph-mon[29649]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:58.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:57 smithi088 ceph-mon[24736]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:58 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:59.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:58 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:58 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:28:59.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:59 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:59.963 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:28:59 smithi088 ceph-mon[29649]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:28:59.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:59 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:28:59.964 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:28:59 smithi088 ceph-mon[24736]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:00.087 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:59 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:00.087 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:28:59 smithi136 ceph-mon[25618]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:01 smithi136 ceph-mon[25618]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:01 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:01 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:01 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:01 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:01 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:01 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[29649]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:02.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[24736]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:02.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:01 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:04.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:03 smithi088 ceph-mon[29649]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:03 smithi088 ceph-mon[24736]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:03 smithi136 ceph-mon[25618]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:04.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:29:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:29:04] "GET /metrics HTTP/1.1" 200 37905 "" "Prometheus/2.33.4" 2024-05-25T05:29:06.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:05 smithi088 ceph-mon[24736]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:05 smithi088 ceph-mon[29649]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:05 smithi136 ceph-mon[25618]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:08.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:07 smithi088 ceph-mon[29649]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:08.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:07 smithi088 ceph-mon[24736]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:07 smithi136 ceph-mon[25618]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:09 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:09 smithi088 ceph-mon[24736]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:09 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:09 smithi088 ceph-mon[29649]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:09 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:09 smithi136 ceph-mon[25618]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:11 smithi136 ceph-mon[25618]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:12.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:11 smithi088 ceph-mon[24736]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:11 smithi088 ceph-mon[29649]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:13 smithi136 ceph-mon[25618]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:14.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:13 smithi088 ceph-mon[29649]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:14.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:14.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:13 smithi088 ceph-mon[24736]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:14.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:14.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:29:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:29:14] "GET /metrics HTTP/1.1" 200 37903 "" "Prometheus/2.33.4" 2024-05-25T05:29:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:15 smithi136 ceph-mon[25618]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:16.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:15 smithi088 ceph-mon[24736]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:15 smithi088 ceph-mon[29649]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:17 smithi136 ceph-mon[25618]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:18.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:17 smithi088 ceph-mon[29649]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:18.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:17 smithi088 ceph-mon[24736]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:19.914 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:19 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:19.914 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:19 smithi136 ceph-mon[25618]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:19 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:19 smithi088 ceph-mon[24736]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:19 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:19 smithi088 ceph-mon[29649]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:21 smithi136 ceph-mon[25618]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:21 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[29649]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:22.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[24736]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:21 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:24.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:23 smithi088 ceph-mon[24736]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:24.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:23 smithi088 ceph-mon[29649]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:24.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:23 smithi136 ceph-mon[25618]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:24.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:29:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:29:24] "GET /metrics HTTP/1.1" 200 37903 "" "Prometheus/2.33.4" 2024-05-25T05:29:26.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:25 smithi088 ceph-mon[29649]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:25 smithi088 ceph-mon[24736]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:26.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:25 smithi136 ceph-mon[25618]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:28.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:27 smithi088 ceph-mon[24736]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:27 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:27 smithi088 ceph-mon[29649]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:27 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:27 smithi136 ceph-mon[25618]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:27 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:29.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:29:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:29:29.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:29:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:29:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:30 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:30.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:29:30.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:29:30.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:30 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:31.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:31 smithi088 ceph-mon[24736]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:31 smithi088 ceph-mon[29649]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:31.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:31 smithi136 ceph-mon[25618]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:33 smithi136 ceph-mon[25618]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:34.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:33 smithi088 ceph-mon[24736]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:34.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:33 smithi088 ceph-mon[29649]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:29:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:29:34] "GET /metrics HTTP/1.1" 200 37899 "" "Prometheus/2.33.4" 2024-05-25T05:29:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:35 smithi136 ceph-mon[25618]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:36.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:35 smithi088 ceph-mon[24736]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:36.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:35 smithi088 ceph-mon[29649]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:37 smithi088 ceph-mon[24736]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:37 smithi088 ceph-mon[29649]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:37 smithi136 ceph-mon[25618]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:39.987 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:39 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:39.987 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:39 smithi136 ceph-mon[25618]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:40.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:39 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:40.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:39 smithi088 ceph-mon[24736]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:39 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:39 smithi088 ceph-mon[29649]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:42.005 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:41 smithi136 ceph-mon[25618]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:42.006 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:41 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.006 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:41 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.006 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:41 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[24736]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[29649]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:41 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:29:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:44.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:44 smithi136 ceph-mon[25618]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:44.494 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:44 smithi088 ceph-mon[29649]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:44.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:44 smithi088 ceph-mon[24736]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:44.495 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:29:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:29:44] "GET /metrics HTTP/1.1" 200 37903 "" "Prometheus/2.33.4" 2024-05-25T05:29:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:46 smithi136 ceph-mon[25618]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:46.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:46 smithi088 ceph-mon[24736]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:46.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:46 smithi088 ceph-mon[29649]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:48 smithi136 ceph-mon[25618]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:48.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:48 smithi088 ceph-mon[29649]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:48.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:48 smithi088 ceph-mon[24736]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:50.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:49 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:49 smithi088 ceph-mon[24736]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:49 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:49 smithi088 ceph-mon[29649]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:49 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:29:50.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:49 smithi136 ceph-mon[25618]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:51 smithi136 ceph-mon[25618]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:52.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:51 smithi088 ceph-mon[24736]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:52.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:51 smithi088 ceph-mon[29649]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:54.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:53 smithi088 ceph-mon[29649]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:54.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:53 smithi088 ceph-mon[24736]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:54.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:53 smithi136 ceph-mon[25618]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:54.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:29:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:29:54] "GET /metrics HTTP/1.1" 200 37903 "" "Prometheus/2.33.4" 2024-05-25T05:29:56.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:55 smithi088 ceph-mon[29649]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:55 smithi088 ceph-mon[24736]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:55 smithi136 ceph-mon[25618]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:29:58.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:57 smithi088 ceph-mon[24736]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:57 smithi088 ceph-mon[29649]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:57 smithi136 ceph-mon[25618]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:29:59.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:58 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:58 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:29:59.352 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:58 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:00.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:59 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:29:59 smithi088 ceph-mon[24736]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:59 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:29:59 smithi088 ceph-mon[29649]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:59 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:29:59 smithi136 ceph-mon[25618]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:00 smithi136 ceph-mon[25618]: overall HEALTH_OK 2024-05-25T05:30:01.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:00 smithi088 ceph-mon[24736]: overall HEALTH_OK 2024-05-25T05:30:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:00 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:30:01.985 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:01 smithi088 ceph-mon[29649]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:01.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:01 smithi088 ceph-mon[24736]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:02.192 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:01 smithi136 ceph-mon[25618]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:02 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.086 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:02 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.086 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:02 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.086 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:02 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.086 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:02 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.086 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:02 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:03.086 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:02 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:04.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:04 smithi088 ceph-mon[29649]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:04.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:04 smithi088 ceph-mon[24736]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:04.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:04 smithi136 ceph-mon[25618]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:04.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:30:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:30:04] "GET /metrics HTTP/1.1" 200 37902 "" "Prometheus/2.33.4" 2024-05-25T05:30:06.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:06 smithi088 ceph-mon[24736]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:06 smithi088 ceph-mon[29649]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:06.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:06 smithi136 ceph-mon[25618]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:08.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:08 smithi088 ceph-mon[29649]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:08.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:08 smithi088 ceph-mon[24736]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:08 smithi136 ceph-mon[25618]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:10.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:09 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:09 smithi088 ceph-mon[29649]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:09 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:09 smithi088 ceph-mon[24736]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:09 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:09 smithi136 ceph-mon[25618]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:12.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:11 smithi088 ceph-mon[24736]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:11 smithi088 ceph-mon[29649]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:11 smithi136 ceph-mon[25618]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:14.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:13 smithi088 ceph-mon[29649]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:14.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:13 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:14.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:13 smithi088 ceph-mon[24736]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:14.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:13 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:14.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:13 smithi136 ceph-mon[25618]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:14.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:13 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:14.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:30:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:30:14] "GET /metrics HTTP/1.1" 200 37898 "" "Prometheus/2.33.4" 2024-05-25T05:30:16.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:15 smithi088 ceph-mon[29649]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:15 smithi088 ceph-mon[24736]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:16.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:15 smithi136 ceph-mon[25618]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:18.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:17 smithi088 ceph-mon[24736]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:18.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:17 smithi088 ceph-mon[29649]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:17 smithi136 ceph-mon[25618]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:19 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:19.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:19 smithi136 ceph-mon[25618]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:19 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:19 smithi088 ceph-mon[24736]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:19 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:19 smithi088 ceph-mon[29649]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:21 smithi136 ceph-mon[25618]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:22.222 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:21 smithi088 ceph-mon[29649]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:22.223 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:21 smithi088 ceph-mon[24736]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:23.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:23 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:23 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:23 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:23 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:23 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:23 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:23 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:24.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:24 smithi136 ceph-mon[25618]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:24.482 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:24 smithi088 ceph-mon[29649]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:24.483 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:30:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:30:24] "GET /metrics HTTP/1.1" 200 37898 "" "Prometheus/2.33.4" 2024-05-25T05:30:24.483 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:24 smithi088 ceph-mon[24736]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:26.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:26 smithi136 ceph-mon[25618]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:26.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:26 smithi088 ceph-mon[29649]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:26.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:26 smithi088 ceph-mon[24736]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:28 smithi136 ceph-mon[25618]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:28 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:28.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:28 smithi088 ceph-mon[24736]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:28.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:28 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:28.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:28 smithi088 ceph-mon[29649]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:28.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:28 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[24736]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:30.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[29649]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:30.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:30:30.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:30:30.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:30:30.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:29 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:29 smithi136 ceph-mon[25618]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:30:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:30:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:30:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:31 smithi088 ceph-mon[29649]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:32.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:31 smithi088 ceph-mon[24736]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:31 smithi136 ceph-mon[25618]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:34.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:33 smithi088 ceph-mon[29649]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:34.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:33 smithi088 ceph-mon[24736]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:33 smithi136 ceph-mon[25618]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:30:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:30:34] "GET /metrics HTTP/1.1" 200 37912 "" "Prometheus/2.33.4" 2024-05-25T05:30:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:35 smithi088 ceph-mon[29649]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:35 smithi088 ceph-mon[24736]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:35 smithi136 ceph-mon[25618]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:37 smithi088 ceph-mon[24736]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:37 smithi088 ceph-mon[29649]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:37 smithi136 ceph-mon[25618]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:40.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:39 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:40.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:39 smithi088 ceph-mon[29649]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:40.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:39 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:40.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:39 smithi088 ceph-mon[24736]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:39 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:40.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:39 smithi136 ceph-mon[25618]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:42.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:41 smithi088 ceph-mon[29649]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:42.186 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:41 smithi088 ceph-mon[24736]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:42.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:41 smithi136 ceph-mon[25618]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:43.400 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.401 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.401 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.401 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.401 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.401 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.401 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:43.401 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:43 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:43.559 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:43 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:44.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:30:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:30:44] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:30:46.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:45 smithi088 ceph-mon[29649]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:46.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:45 smithi088 ceph-mon[24736]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:46.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:45 smithi136 ceph-mon[25618]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:48.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:47 smithi088 ceph-mon[24736]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:48.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:47 smithi088 ceph-mon[29649]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:47 smithi136 ceph-mon[25618]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:50.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:49 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:50.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:49 smithi088 ceph-mon[29649]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:49 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:50.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:49 smithi088 ceph-mon[24736]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:49 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:30:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:49 smithi136 ceph-mon[25618]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:52.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:51 smithi088 ceph-mon[29649]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:52.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:51 smithi088 ceph-mon[24736]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:51 smithi136 ceph-mon[25618]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:54.280 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:53 smithi088 ceph-mon[29649]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:54.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:53 smithi088 ceph-mon[24736]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:54.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:53 smithi136 ceph-mon[25618]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:54.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:30:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:30:54] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:30:56.280 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:55 smithi088 ceph-mon[29649]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:56.280 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:55 smithi088 ceph-mon[24736]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:56.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:55 smithi136 ceph-mon[25618]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:30:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:57 smithi088 ceph-mon[29649]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:57 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:58.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:57 smithi088 ceph-mon[24736]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:58.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:57 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:30:58.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:57 smithi136 ceph-mon[25618]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:30:58.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:57 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:00.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:59 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:00.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:30:59 smithi136 ceph-mon[25618]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:00.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:59 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:00.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:30:59 smithi088 ceph-mon[24736]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:00.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:59 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:00.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:30:59 smithi088 ceph-mon[29649]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:02.207 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:01 smithi088 ceph-mon[24736]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:02.207 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:01 smithi088 ceph-mon[29649]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:02.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:01 smithi136 ceph-mon[25618]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:03.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:03 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:03 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:03 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:03 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:03 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:03 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:03 smithi136 ceph-mon[25618]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[29649]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:03.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:03.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:03 smithi088 ceph-mon[24736]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:04.469 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:31:04] "GET /metrics HTTP/1.1" 200 37911 "" "Prometheus/2.33.4" 2024-05-25T05:31:06.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:05 smithi088 ceph-mon[29649]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:06.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:05 smithi088 ceph-mon[24736]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:05 smithi136 ceph-mon[25618]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:08.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:07 smithi088 ceph-mon[24736]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:07 smithi088 ceph-mon[29649]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:07 smithi136 ceph-mon[25618]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:10.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:09 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:09 smithi088 ceph-mon[29649]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:09 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:10.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:09 smithi088 ceph-mon[24736]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:09 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:09 smithi136 ceph-mon[25618]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:11 smithi088 ceph-mon[29649]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:11 smithi088 ceph-mon[24736]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:11 smithi136 ceph-mon[25618]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:13.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:12 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:13.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:12 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:13.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:12 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:14.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:13 smithi088 ceph-mon[24736]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:14.236 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:13 smithi088 ceph-mon[29649]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:14.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:13 smithi136 ceph-mon[25618]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:14.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:31:14] "GET /metrics HTTP/1.1" 200 37908 "" "Prometheus/2.33.4" 2024-05-25T05:31:16.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:15 smithi088 ceph-mon[24736]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:15 smithi088 ceph-mon[29649]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:16.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:15 smithi136 ceph-mon[25618]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:17.678 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:31:18.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:17 smithi088 ceph-mon[29649]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:18.180 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:17 smithi088 ceph-mon[24736]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:17 smithi136 ceph-mon[25618]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 17s ago 22m - - 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 17s ago 22m - - 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (9m) 17s ago 17m 22.6M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (8m) 17s ago 17m 53.7M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (2m) 17s ago 16m 49.0M - 3.5 e1d6a67b021e da0473aea7dc 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283 running (11m) 17s ago 22m 451M - 19.0.0-2843-gea0684c0 f9a9809cafd6 1d0d66e6da75 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (6m) 17s ago 23m 511M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:31:19.788 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (23m) 17s ago 23m 75.4M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (22m) 17s ago 22m 53.2M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (22m) 17s ago 22m 52.6M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (9m) 17s ago 18m 20.0M - 1.3.1 1dbe0e931976 a11a34b18e29 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (8m) 17s ago 18m 17.9M - 1.3.1 1dbe0e931976 85883e864814 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (21m) 17s ago 21m 53.1M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (21m) 17s ago 21m 54.1M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (20m) 17s ago 20m 49.3M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (20m) 17s ago 20m 55.6M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (20m) 17s ago 20m 53.7M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (19m) 17s ago 19m 50.7M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (19m) 17s ago 19m 52.4M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (19m) 17s ago 19m 53.3M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (2m) 17s ago 18m 67.3M - 2.33.4 514e6a882f6e f822abe30275 2024-05-25T05:31:19.789 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (16m) 17s ago 16m 75.4M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:31:19.790 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (16m) 17s ago 16m 76.5M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:31:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:19 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:20.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:19 smithi088 ceph-mon[24736]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:19 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:19 smithi088 ceph-mon[29649]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:19 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:20.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:19 smithi136 ceph-mon[25618]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:20.359 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions' 2024-05-25T05:31:21.013 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:20 smithi088 ceph-mon[24736]: from='client.25165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:31:21.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:20 smithi088 ceph-mon[29649]: from='client.25165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:31:21.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:20 smithi136 ceph-mon[25618]: from='client.25165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:31:22.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:21 smithi088 ceph-mon[24736]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:22.004 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:21 smithi088 ceph-mon[29649]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:21 smithi136 ceph-mon[25618]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:22.391 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:31:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:31:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:31:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:31:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:31:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:31:22.391 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:31:22.392 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:31:23.033 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/358275074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/358275074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:31:23.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:22 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.056 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph -s' 2024-05-25T05:31:23.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:22 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/358275074' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:31:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:22 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:23 smithi136 ceph-mon[25618]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:24.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:23 smithi088 ceph-mon[29649]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:24.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:23 smithi088 ceph-mon[24736]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:24.502 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:31:24] "GET /metrics HTTP/1.1" 200 37908 "" "Prometheus/2.33.4" 2024-05-25T05:31:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:25 smithi088 ceph-mon[24736]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:25 smithi088 ceph-mon[29649]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:26.125 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:25 smithi136 ceph-mon[25618]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: cluster: 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: id: 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: health: HEALTH_OK 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: services: 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: mon: 3 daemons, quorum a,c,b (age 22m) 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: mgr: y(active, since 3m), standbys: x 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: osd: 8 osds: 8 up (since 19m), 8 in (since 19m) 2024-05-25T05:31:26.280 INFO:teuthology.orchestra.run.smithi088.stdout: rgw: 2 daemons active (2 hosts, 1 zones) 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: data: 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: pools: 6 pools, 161 pgs 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: objects: 241 objects, 585 KiB 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: usage: 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: pgs: 161 active+clean 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: io: 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: client: 1.2 KiB/s rd, 1 op/s rd, 0 op/s wr 2024-05-25T05:31:26.281 INFO:teuthology.orchestra.run.smithi088.stdout: 2024-05-25T05:31:27.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:26 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1315737943' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:31:27.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:26 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1315737943' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:31:27.085 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph health detail' 2024-05-25T05:31:27.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:26 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1315737943' entity='client.admin' cmd=[{"prefix": "status"}]: dispatch 2024-05-25T05:31:28.151 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:27 smithi088 ceph-mon[29649]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:28.151 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:27 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:28.151 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:27 smithi088 ceph-mon[24736]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:28.151 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:27 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:27 smithi136 ceph-mon[25618]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:28.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:27 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:29.834 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2024-05-25T05:31:29.834 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[29649]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[29649]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[24736]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:29.835 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:29 smithi088 ceph-mon[24736]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:29 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:29 smithi136 ceph-mon[25618]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:30.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:29 smithi136 ceph-mon[25618]: from='mgr.15180 172.21.15.88:0/2846580488' entity='mgr.y' 2024-05-25T05:31:30.489 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-05-25T05:31:31.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:30 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1441456991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:31:31.016 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:30 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1441456991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:31:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:30 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1441456991' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:31:31.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:31 smithi088 ceph-mon[29649]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:31.981 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:31 smithi088 ceph-mon[24736]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:31 smithi136 ceph-mon[25618]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:32.495 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:31:33.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:32 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/387393737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:31:33.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:32 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/387393737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:31:33.127 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph mgr fail' 2024-05-25T05:31:33.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:32 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/387393737' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:31:34.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:33 smithi088 ceph-mon[29649]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:33 smithi088 ceph-mon[24736]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:33 smithi136 ceph-mon[25618]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:31:34.393 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:31:34] "GET /metrics HTTP/1.1" 200 37910 "" "Prometheus/2.33.4" 2024-05-25T05:31:36.206 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:35 smithi136 ceph-mon[25618]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:35 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1776714841' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:35 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:35 smithi136 ceph-mon[25618]: osdmap e106: 8 total, 8 up, 8 in 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:35 smithi136 ceph-mon[25618]: Standby manager daemon y started 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:31:35] ENGINE Bus STOPPING 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:31:35] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:31:35] ENGINE Bus STOPPED 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:31:36] ENGINE Bus STARTING 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:31:36] ENGINE Serving on http://:::9283 2024-05-25T05:31:36.207 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:31:36] ENGINE Bus STARTED 2024-05-25T05:31:36.294 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[29649]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:36.294 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1776714841' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:31:36.294 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:31:36.294 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[29649]: osdmap e106: 8 total, 8 up, 8 in 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[29649]: Standby manager daemon y started 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[24736]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1776714841' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd=[{"prefix": "mgr fail"}]: dispatch 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[24736]: osdmap e106: 8 total, 8 up, 8 in 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mon[24736]: Standby manager daemon y started 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:35.918+0000 7fef39934700 -1 mgr handle_mgr_map I was active but no longer am 2024-05-25T05:31:36.295 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ignoring --setuser ceph since I am not root 2024-05-25T05:31:36.296 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ignoring --setgroup ceph since I am not root 2024-05-25T05:31:36.296 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:35 smithi088 ceph-mgr[70724]: -- 172.21.15.88:0/1590930327 <== mon.0 v2:172.21.15.88:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55f7376645a0 con 0x55f737639000 2024-05-25T05:31:36.296 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:36.105+0000 7f8284d57200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:31:36.296 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:36.293+0000 7f8284d57200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:31:36.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:36.398+0000 7f8284d57200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:31:36.642 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'sleep 180' 2024-05-25T05:31:36.918 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:36.722+0000 7f8284d57200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:31:36.919 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:36 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:36.817+0000 7f8284d57200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:31:36.919 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:31:36.919 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: mgrmap e31: x(active, starting, since 0.806248s), standbys: y 2024-05-25T05:31:36.920 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:31:36.920 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: mgrmap e31: x(active, starting, since 0.806248s), standbys: y 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:31:37.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:31:37.198 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: Manager daemon x is now available 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: [25/May/2024:05:31:36] ENGINE Bus STARTING 2024-05-25T05:31:37.199 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: [25/May/2024:05:31:36] ENGINE Serving on http://172.21.15.136:8765 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: [25/May/2024:05:31:36] ENGINE Serving on https://172.21.15.136:7150 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: [25/May/2024:05:31:36] ENGINE Bus STARTED 2024-05-25T05:31:37.200 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:36 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:31:37.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: Manager daemon x is now available 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:31:37.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: [25/May/2024:05:31:36] ENGINE Bus STARTING 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: [25/May/2024:05:31:36] ENGINE Serving on http://172.21.15.136:8765 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: [25/May/2024:05:31:36] ENGINE Serving on https://172.21.15.136:7150 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: [25/May/2024:05:31:36] ENGINE Bus STARTED 2024-05-25T05:31:37.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='client.? ' entity='client.admin' cmd='[{"prefix": "mgr fail"}]': finished 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: mgrmap e31: x(active, starting, since 0.806248s), standbys: y 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:31:37.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: Manager daemon x is now available 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:31:37.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/x/trash_purge_schedule"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: [25/May/2024:05:31:36] ENGINE Bus STARTING 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:37.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: [25/May/2024:05:31:36] ENGINE Serving on http://172.21.15.136:8765 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: [25/May/2024:05:31:36] ENGINE Serving on https://172.21.15.136:7150 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: [25/May/2024:05:31:36] ENGINE Bus STARTED 2024-05-25T05:31:37.305 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:36 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.087 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: mgrmap e32: x(active, since 1.81628s), standbys: y 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:31:38.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:31:38.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.089 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:37 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: mgrmap e32: x(active, since 1.81628s), standbys: y 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: mgrmap e32: x(active, since 1.81628s), standbys: y 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:31:38.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:31:38.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:31:38.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:37 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:38.482 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:38.180+0000 7f8284d57200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:31:38.482 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:38.368+0000 7f8284d57200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:31:38.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:38.563+0000 7f8284d57200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:31:39.182 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:38.864+0000 7f8284d57200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:31:39.182 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:38 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:38.964+0000 7f8284d57200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:39.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[24736]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:31:39.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:39.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:39.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:39.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:31:39.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:38 smithi088 ceph-mon[29649]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:39.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:38 smithi136 ceph-mon[25618]: from='client.15258 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:31:39.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:39.178+0000 7f8284d57200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:31:39.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:39.380+0000 7f8284d57200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:31:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:39 smithi136 ceph-mon[25618]: mgrmap e33: x(active, since 3s), standbys: y 2024-05-25T05:31:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:39 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:39 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:39 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.253 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:40.015+0000 7f8284d57200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:31:40.254 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[29649]: mgrmap e33: x(active, since 3s), standbys: y 2024-05-25T05:31:40.254 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.254 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.254 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[24736]: mgrmap e33: x(active, since 3s), standbys: y 2024-05-25T05:31:40.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:39 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:40.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:40.526+0000 7f8284d57200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:31:40.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:40.650+0000 7f8284d57200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:31:41.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:40 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:40.886+0000 7f8284d57200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:31:41.442 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:41 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:41.429+0000 7f8284d57200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:31:41.691 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:41 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:41.561+0000 7f8284d57200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:31:41.691 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[24736]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:41.691 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.691 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.691 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.691 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.691 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[29649]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:41.692 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.692 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.692 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.692 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:41 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:41 smithi136 ceph-mon[25618]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:41 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:41 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:41 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:41 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:41 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:41.834+0000 7f8284d57200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:31:42.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:41 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:41.973+0000 7f8284d57200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:31:42.366 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:42.074+0000 7f8284d57200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:31:42.367 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:42.200+0000 7f8284d57200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:31:42.719 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:42 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.719 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:42 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.719 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:42 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.733 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:42.512+0000 7f8284d57200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:31:42.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:42 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:42 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:42 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:42 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:42 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:42.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:42 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:43.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:43.159+0000 7f8284d57200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:31:43.638 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:43.392+0000 7f8284d57200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:31:43.638 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:31:43] ENGINE Bus STARTING 2024-05-25T05:31:43.639 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: CherryPy Checker: 2024-05-25T05:31:43.639 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: The Application mounted at '' has an empty config. 2024-05-25T05:31:43.639 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:31:43.639 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:31:43] ENGINE Serving on http://:::9283 2024-05-25T05:31:43.639 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:31:43] ENGINE Bus STARTED 2024-05-25T05:31:44.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: Standby manager daemon y restarted 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: Standby manager daemon y started 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:31:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: Standby manager daemon y restarted 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: Standby manager daemon y started 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:31:44.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:43 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:31:44.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: Standby manager daemon y restarted 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: Standby manager daemon y started 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/crt"}]: dispatch 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/y/key"}]: dispatch 2024-05-25T05:31:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:43 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:31:44.468 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:31:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:31:44] "GET /metrics HTTP/1.1" 200 - "" "Prometheus/2.33.4" 2024-05-25T05:31:45.121 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:44 smithi088 ceph-mon[29649]: mgrmap e34: x(active, since 8s), standbys: y 2024-05-25T05:31:45.121 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:44 smithi088 ceph-mon[24736]: mgrmap e34: x(active, since 8s), standbys: y 2024-05-25T05:31:45.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:44 smithi136 ceph-mon[25618]: mgrmap e34: x(active, since 8s), standbys: y 2024-05-25T05:31:45.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:31:45.184+0000 7fac2234b700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:45.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Creating ceph-iscsi config... 2024-05-25T05:31:45.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:45.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:45.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:45.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return _run_code(code, main_globals, None, 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: exec(code, run_globals) 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:45.636 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:31:45.637 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return future.result(timeout) 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return self.__get_result() 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: raise self._exception 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: use_current_daemon_image=reconfig, 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Creating ceph-iscsi config... 2024-05-25T05:31:45.638 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: Traceback (most recent call last): 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: return _run_code(code, main_globals, None, 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: exec(code, run_globals) 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:45.639 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:45.640 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:45.640 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:45.640 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:31:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:46.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:45 smithi088 ceph-mon[24736]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:31:46.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:45 smithi088 ceph-mon[29649]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:31:46.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:45 smithi136 ceph-mon[25618]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:31:47.005 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:46 smithi088 ceph-mon[29649]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:47.005 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:31:47.005 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:47.006 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:31:47.007 INFO:journalctl@ceph.mon.c.smithi088.stdout: return future.result(timeout) 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.__get_result() 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: raise self._exception 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:47.008 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:47.009 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:46 smithi088 ceph-mon[24736]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:47.010 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:31:47.011 INFO:journalctl@ceph.mon.a.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:31:47.012 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:31:47.012 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:31:47.012 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:31:47.012 INFO:journalctl@ceph.mon.a.smithi088.stdout: return future.result(timeout) 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.__get_result() 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: raise self._exception 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.014 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.014 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.014 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:47.014 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:31:47.014 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:47.014 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:31:47.015 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:47.015 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:47.015 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:47.015 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:46 smithi088 ceph-mon[24736]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:46 smithi088 ceph-mon[24736]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:47.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:47.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.017 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:46 smithi088 ceph-mon[29649]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:31:47.017 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:46 smithi088 ceph-mon[29649]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:46 smithi136 ceph-mon[25618]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:31:47.120 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:31:47.121 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: return future.result(timeout) 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.__get_result() 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: raise self._exception 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:31:47.122 INFO:journalctl@ceph.mon.b.smithi136.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:31:47.123 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:46 smithi136 ceph-mon[25618]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:31:47.124 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:46 smithi136 ceph-mon[25618]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:31:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:47 smithi136 ceph-mon[25618]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:31:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:47 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:47 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:47 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[24736]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:31:48.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[29649]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:31:48.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:47 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:48.859 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:31:48.859 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 bash[66699]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:31:49.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.859Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.859Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.859Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.859Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.859Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.859Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.860Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.860Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.860Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.860Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.860Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[62221]: ts=2024-05-25T05:31:48.860Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-25T05:31:49.135 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:48 smithi136 podman[66709]: 2024-05-25 05:31:48.869869232 +0000 UTC m=+0.242976530 container died f822abe302751789e49123a3a395802165238d713d7dccca18dd5aa00edebf90 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:31:49.502 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 podman[66709]: 2024-05-25 05:31:49.25917662 +0000 UTC m=+0.632283939 container cleanup f822abe302751789e49123a3a395802165238d713d7dccca18dd5aa00edebf90 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:31:49.502 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 bash[66709]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:31:49.502 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 bash[66735]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:31:49.769 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 podman[66723]: 2024-05-25 05:31:49.502414372 +0000 UTC m=+0.628403818 container remove f822abe302751789e49123a3a395802165238d713d7dccca18dd5aa00edebf90 (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:31:49.769 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-25T05:31:49.769 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 systemd[1]: Stopped Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:31:49.769 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Consumed 1.372s CPU time. 2024-05-25T05:31:49.770 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 systemd[1]: Starting Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:31:49.770 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 podman[66799]: 2024-05-25 05:31:49.643491613 +0000 UTC m=+0.018364874 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-25T05:31:49.770 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 podman[66799]: 2024-05-25 05:31:49.770249188 +0000 UTC m=+0.145122444 container create c328bce93da9adab72548d23b497994dcc3aa8079d58703cf5edf1053d8e62bb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:31:50.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:49 smithi136 ceph-mon[25618]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 podman[66799]: 2024-05-25 05:31:49.97256895 +0000 UTC m=+0.347442218 container init c328bce93da9adab72548d23b497994dcc3aa8079d58703cf5edf1053d8e62bb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 podman[66799]: 2024-05-25 05:31:49.975445326 +0000 UTC m=+0.350318588 container start c328bce93da9adab72548d23b497994dcc3aa8079d58703cf5edf1053d8e62bb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:49.998Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:49.998Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:49.998Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:49.998Z caller=main.go:518 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:49.998Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:31:50.072 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:49.998Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.000Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.000Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.001Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.003Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.003Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.44µs 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.003Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.004Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=4 2024-05-25T05:31:50.073 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 bash[66799]: c328bce93da9adab72548d23b497994dcc3aa8079d58703cf5edf1053d8e62bb 2024-05-25T05:31:50.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:49 smithi088 ceph-mon[29649]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:31:50.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:49 smithi088 ceph-mon[24736]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:31:50.384 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:31:50.753 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.481Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=4 2024-05-25T05:31:50.754 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.694Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=4 2024-05-25T05:31:50.754 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.754Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=4 2024-05-25T05:31:51.107 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.754Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=4 2024-05-25T05:31:51.108 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.754Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=32.912µs wal_replay_duration=751.582785ms total_replay_duration=751.6276ms 2024-05-25T05:31:51.108 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.758Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:31:51.108 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.758Z caller=main.go:947 level=info msg="TSDB started" 2024-05-25T05:31:51.108 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.758Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:31:51.108 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.782Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=23.953333ms db_storage=735ns remote_storage=1.66µs web_handler=387ns query_engine=790ns scrape=593.813µs scrape_sd=101.206µs notify=16.746µs notify_sd=17.595µs rules=22.906236ms 2024-05-25T05:31:51.108 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:31:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:31:50.782Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-25T05:31:51.183 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:51.184 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:51.185 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.186 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:31:51.186 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:51.186 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:51.186 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:51.186 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:31:51.186 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:51.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:51.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:31:51.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:31:53.349 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:53 smithi088 ceph-mon[29649]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:53.349 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:53 smithi088 ceph-mon[24736]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:53.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:53 smithi136 ceph-mon[25618]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:54.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3061880590' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/330757800' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]: dispatch 2024-05-25T05:31:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3061880590' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:31:54.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/330757800' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]: dispatch 2024-05-25T05:31:54.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:54 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]: dispatch 2024-05-25T05:31:54.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mon.? -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3061880590' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/330757800' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]: dispatch 2024-05-25T05:31:54.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:54 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]: dispatch 2024-05-25T05:31:55.983 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[24736]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:55.983 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]': finished 2024-05-25T05:31:55.983 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[24736]: osdmap e107: 8 total, 8 up, 8 in 2024-05-25T05:31:55.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/699781357' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]: dispatch 2024-05-25T05:31:55.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]: dispatch 2024-05-25T05:31:55.984 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[29649]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:55.984 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]': finished 2024-05-25T05:31:55.984 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[29649]: osdmap e107: 8 total, 8 up, 8 in 2024-05-25T05:31:55.984 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/699781357' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]: dispatch 2024-05-25T05:31:55.984 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:55 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]: dispatch 2024-05-25T05:31:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:55 smithi136 ceph-mon[25618]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:31:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:55 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1040991206"}]': finished 2024-05-25T05:31:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:55 smithi136 ceph-mon[25618]: osdmap e107: 8 total, 8 up, 8 in 2024-05-25T05:31:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:55 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/699781357' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]: dispatch 2024-05-25T05:31:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:55 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]: dispatch 2024-05-25T05:31:57.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]': finished 2024-05-25T05:31:57.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[29649]: osdmap e108: 8 total, 8 up, 8 in 2024-05-25T05:31:57.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2030251147' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]: dispatch 2024-05-25T05:31:57.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]: dispatch 2024-05-25T05:31:57.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]': finished 2024-05-25T05:31:57.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[24736]: osdmap e108: 8 total, 8 up, 8 in 2024-05-25T05:31:57.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2030251147' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]: dispatch 2024-05-25T05:31:57.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:56 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]: dispatch 2024-05-25T05:31:57.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:56 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6801/3518644391"}]': finished 2024-05-25T05:31:57.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:56 smithi136 ceph-mon[25618]: osdmap e108: 8 total, 8 up, 8 in 2024-05-25T05:31:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:56 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2030251147' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]: dispatch 2024-05-25T05:31:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:56 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]: dispatch 2024-05-25T05:31:58.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[24736]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:58.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]': finished 2024-05-25T05:31:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[24736]: osdmap e109: 8 total, 8 up, 8 in 2024-05-25T05:31:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3897166381' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1174396959"}]: dispatch 2024-05-25T05:31:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[29649]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]': finished 2024-05-25T05:31:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[29649]: osdmap e109: 8 total, 8 up, 8 in 2024-05-25T05:31:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:57 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3897166381' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1174396959"}]: dispatch 2024-05-25T05:31:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:57 smithi136 ceph-mon[25618]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 96 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:31:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:57 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/3473027940"}]': finished 2024-05-25T05:31:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:57 smithi136 ceph-mon[25618]: osdmap e109: 8 total, 8 up, 8 in 2024-05-25T05:31:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:57 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3897166381' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1174396959"}]: dispatch 2024-05-25T05:31:59.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3897166381' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1174396959"}]': finished 2024-05-25T05:31:59.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[29649]: osdmap e110: 8 total, 8 up, 8 in 2024-05-25T05:31:59.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/4220595172' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]: dispatch 2024-05-25T05:31:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]: dispatch 2024-05-25T05:31:59.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3897166381' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1174396959"}]': finished 2024-05-25T05:31:59.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[24736]: osdmap e110: 8 total, 8 up, 8 in 2024-05-25T05:31:59.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/4220595172' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]: dispatch 2024-05-25T05:31:59.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:58 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]: dispatch 2024-05-25T05:31:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:58 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3897166381' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/1174396959"}]': finished 2024-05-25T05:31:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:58 smithi136 ceph-mon[25618]: osdmap e110: 8 total, 8 up, 8 in 2024-05-25T05:31:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:58 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/4220595172' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]: dispatch 2024-05-25T05:31:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:58 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]: dispatch 2024-05-25T05:32:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:59 smithi136 ceph-mon[25618]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:32:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:59 smithi136 ceph-mon[25618]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]': finished 2024-05-25T05:32:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:59 smithi136 ceph-mon[25618]: osdmap e111: 8 total, 8 up, 8 in 2024-05-25T05:32:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:31:59 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3226528503' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3518644391"}]: dispatch 2024-05-25T05:32:00.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[29649]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:32:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[29649]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]': finished 2024-05-25T05:32:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[29649]: osdmap e111: 8 total, 8 up, 8 in 2024-05-25T05:32:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3226528503' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3518644391"}]: dispatch 2024-05-25T05:32:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[24736]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:32:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[24736]: from='client.? ' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:0/814394134"}]': finished 2024-05-25T05:32:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[24736]: osdmap e111: 8 total, 8 up, 8 in 2024-05-25T05:32:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:31:59 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3226528503' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3518644391"}]: dispatch 2024-05-25T05:32:01.008 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:00 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3226528503' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3518644391"}]': finished 2024-05-25T05:32:01.009 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:00 smithi136 ceph-mon[25618]: osdmap e112: 8 total, 8 up, 8 in 2024-05-25T05:32:01.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:00 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3226528503' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3518644391"}]': finished 2024-05-25T05:32:01.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:00 smithi088 ceph-mon[24736]: osdmap e112: 8 total, 8 up, 8 in 2024-05-25T05:32:01.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:00 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3226528503' entity='client.iscsi.foo.smithi088.khxvsc' cmd='[{"prefix": "osd blocklist", "blocklistop": "rm", "addr": "172.21.15.88:6800/3518644391"}]': finished 2024-05-25T05:32:01.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:00 smithi088 ceph-mon[29649]: osdmap e112: 8 total, 8 up, 8 in 2024-05-25T05:32:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:01 smithi136 ceph-mon[25618]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:32:02.293 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:01 smithi088 ceph-mon[29649]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:32:02.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:01 smithi088 ceph-mon[24736]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1023 B/s rd, 1 op/s 2024-05-25T05:32:04.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:03 smithi136 ceph-mon[25618]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-05-25T05:32:04.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:03 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:03 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:03 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.133 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:32:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:32:04] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:32:04.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[24736]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-05-25T05:32:04.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[29649]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 796 B/s rd, 0 op/s 2024-05-25T05:32:04.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:03 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.985 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:04.985 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.985 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.985 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:04.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:04.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:05.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:04 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:05.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:05.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:05.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:05.922 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:05 smithi088 ceph-mon[24736]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-05-25T05:32:05.922 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:05 smithi088 ceph-mon[29649]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-05-25T05:32:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:05 smithi136 ceph-mon[25618]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 833 B/s rd, 0 op/s 2024-05-25T05:32:07.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[24736]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-25T05:32:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[29649]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-25T05:32:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:06 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:07.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:06 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:06 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:06 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:07.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:06 smithi136 ceph-mon[25618]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-25T05:32:07.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:06 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:10.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:09 smithi088 ceph-mon[24736]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:32:10.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:09 smithi088 ceph-mon[29649]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:32:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:09 smithi136 ceph-mon[25618]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:32:12.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:11 smithi088 ceph-mon[24736]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-05-25T05:32:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:11 smithi088 ceph-mon[29649]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-05-25T05:32:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:11 smithi136 ceph-mon[25618]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1010 B/s rd, 0 op/s 2024-05-25T05:32:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:13 smithi088 ceph-mon[24736]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:13 smithi088 ceph-mon[29649]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:13 smithi136 ceph-mon[25618]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:14.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:32:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:32:14] "GET /metrics HTTP/1.1" 200 37911 "" "Prometheus/2.33.4" 2024-05-25T05:32:15.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:14 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:14 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:14 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:15 smithi088 ceph-mon[24736]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:15 smithi088 ceph-mon[29649]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:16.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:15 smithi136 ceph-mon[25618]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:18.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:17 smithi088 ceph-mon[24736]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:18.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:17 smithi088 ceph-mon[29649]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:17 smithi136 ceph-mon[25618]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:20.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:19 smithi088 ceph-mon[29649]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:19 smithi088 ceph-mon[24736]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:19 smithi136 ceph-mon[25618]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:22.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:21 smithi088 ceph-mon[29649]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:21 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:21 smithi088 ceph-mon[24736]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:21 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:21 smithi136 ceph-mon[25618]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:21 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:23 smithi136 ceph-mon[25618]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:23 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:23 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:23 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.922 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[29649]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:23.923 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.923 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.923 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[24736]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:23.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:23.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:23 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:24.321 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:32:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:32:24] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:32:24.916 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:24 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:24.916 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:24.916 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:24.916 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:25.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:26.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:25 smithi088 ceph-mon[29649]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:25 smithi088 ceph-mon[24736]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:25 smithi136 ceph-mon[25618]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:28.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:27 smithi088 ceph-mon[24736]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:27 smithi088 ceph-mon[29649]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:27 smithi136 ceph-mon[25618]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:30.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:29 smithi088 ceph-mon[29649]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:29 smithi088 ceph-mon[24736]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:29 smithi136 ceph-mon[25618]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:32.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:31 smithi088 ceph-mon[29649]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:31 smithi088 ceph-mon[24736]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:32.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:31 smithi136 ceph-mon[25618]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:33 smithi136 ceph-mon[25618]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:34.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:32:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:32:34] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:32:34.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:33 smithi088 ceph-mon[24736]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:34.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:33 smithi088 ceph-mon[29649]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:35.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:34 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:35.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:34 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:35.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:34 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:35 smithi136 ceph-mon[25618]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:35 smithi088 ceph-mon[29649]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:35 smithi088 ceph-mon[24736]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:37.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:37.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:38.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:37 smithi136 ceph-mon[25618]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:37 smithi088 ceph-mon[24736]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:37 smithi088 ceph-mon[29649]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:39 smithi136 ceph-mon[25618]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:40.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:39 smithi088 ceph-mon[29649]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:40.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:39 smithi088 ceph-mon[24736]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:42.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:41 smithi136 ceph-mon[25618]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:42.261 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:41 smithi088 ceph-mon[29649]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:42.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:41 smithi088 ceph-mon[24736]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:44.002 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:43 smithi136 ceph-mon[25618]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:44.002 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:43 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.002 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:43 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.002 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:43 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[24736]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:44.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[29649]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:44.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:43 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:44.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:32:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:32:44] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:32:45.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:44 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:45.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:45 smithi136 ceph-mon[25618]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:46.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:45 smithi088 ceph-mon[29649]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:46.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:45 smithi088 ceph-mon[24736]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:47 smithi136 ceph-mon[25618]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:48.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:47 smithi088 ceph-mon[29649]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:48.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:47 smithi088 ceph-mon[24736]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:49 smithi136 ceph-mon[25618]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:50.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:49 smithi088 ceph-mon[29649]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:50.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:49 smithi088 ceph-mon[24736]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:51 smithi136 ceph-mon[25618]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:52.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:51 smithi088 ceph-mon[29649]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:52.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:52.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:51 smithi088 ceph-mon[24736]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:52.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:32:54.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:32:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:32:54] "GET /metrics HTTP/1.1" 200 37908 "" "Prometheus/2.33.4" 2024-05-25T05:32:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:53 smithi136 ceph-mon[25618]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:32:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:32:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:32:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:53 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[24736]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:32:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:32:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:32:54.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:54.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[29649]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:54.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:32:54.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:32:54.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:32:54.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:53 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:32:55.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:54 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:55.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:54 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:55.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:54 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:32:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:55 smithi136 ceph-mon[25618]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:56.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:55 smithi088 ceph-mon[29649]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:55 smithi088 ceph-mon[24736]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:32:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:57 smithi136 ceph-mon[25618]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:58.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:57 smithi088 ceph-mon[29649]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:32:58.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:57 smithi088 ceph-mon[24736]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:32:59 smithi136 ceph-mon[25618]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:00.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:32:59 smithi088 ceph-mon[29649]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:32:59 smithi088 ceph-mon[24736]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:02.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:01 smithi136 ceph-mon[25618]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:02.199 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:01 smithi088 ceph-mon[24736]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:02.199 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:01 smithi088 ceph-mon[29649]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[24736]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[29649]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:03 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:33:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:33:04] "GET /metrics HTTP/1.1" 200 37908 "" "Prometheus/2.33.4" 2024-05-25T05:33:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:03 smithi136 ceph-mon[25618]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:03 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:03 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:03 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:04 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:05.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:05.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:06.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:05 smithi088 ceph-mon[24736]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:05 smithi088 ceph-mon[29649]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:06.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:05 smithi136 ceph-mon[25618]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:07.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:06 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:07.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:06 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:07.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:06 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:08.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:07 smithi088 ceph-mon[24736]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:07 smithi088 ceph-mon[29649]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:08.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:07 smithi136 ceph-mon[25618]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:10.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:09 smithi088 ceph-mon[24736]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:10.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:09 smithi088 ceph-mon[29649]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:09 smithi136 ceph-mon[25618]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:12.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:11 smithi088 ceph-mon[24736]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:11 smithi088 ceph-mon[29649]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:11 smithi136 ceph-mon[25618]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:14.187 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:13 smithi136 ceph-mon[25618]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:14.187 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:33:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:33:14] "GET /metrics HTTP/1.1" 200 37908 "" "Prometheus/2.33.4" 2024-05-25T05:33:14.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:13 smithi088 ceph-mon[24736]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:14.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:13 smithi088 ceph-mon[29649]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:15.203 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:14 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:15.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:14 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:14 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:16.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:15 smithi088 ceph-mon[24736]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:15 smithi088 ceph-mon[29649]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:16.349 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:15 smithi136 ceph-mon[25618]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:17.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:16 smithi088 ceph-mon[24736]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:17.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:16 smithi088 ceph-mon[29649]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:17.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:16 smithi136 ceph-mon[25618]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:20.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:19 smithi088 ceph-mon[29649]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:19 smithi088 ceph-mon[24736]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:19 smithi136 ceph-mon[25618]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:22.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:21 smithi088 ceph-mon[24736]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:22.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:21 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:21 smithi088 ceph-mon[29649]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:22.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:21 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:21 smithi136 ceph-mon[25618]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:21 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:24.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:23 smithi088 ceph-mon[24736]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:24.045 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:23 smithi088 ceph-mon[29649]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:24.063 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:23 smithi136 ceph-mon[25618]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:24.064 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:33:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:33:24] "GET /metrics HTTP/1.1" 200 37904 "" "Prometheus/2.33.4" 2024-05-25T05:33:25.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:24 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:26.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:25 smithi088 ceph-mon[29649]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:25 smithi088 ceph-mon[24736]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:25 smithi136 ceph-mon[25618]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:28.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:27 smithi088 ceph-mon[29649]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:28.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:27 smithi088 ceph-mon[24736]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:27 smithi136 ceph-mon[25618]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:30.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:29 smithi088 ceph-mon[29649]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:29 smithi088 ceph-mon[24736]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:29 smithi136 ceph-mon[25618]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:32.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:31 smithi088 ceph-mon[29649]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:31 smithi088 ceph-mon[24736]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:31 smithi136 ceph-mon[25618]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:34.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:33 smithi088 ceph-mon[29649]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:33 smithi088 ceph-mon[24736]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:34.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:33 smithi136 ceph-mon[25618]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:34.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:33:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:33:34] "GET /metrics HTTP/1.1" 200 37904 "" "Prometheus/2.33.4" 2024-05-25T05:33:35.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:34 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:35.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:34 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:35.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:34 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:36.116 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:35 smithi136 ceph-mon[25618]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:35 smithi088 ceph-mon[29649]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:35 smithi088 ceph-mon[24736]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:37.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:37.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:37 smithi136 ceph-mon[25618]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:37 smithi088 ceph-mon[24736]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:37 smithi088 ceph-mon[29649]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:39 smithi136 ceph-mon[25618]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:40.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:39 smithi088 ceph-mon[24736]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:40.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:39 smithi088 ceph-mon[29649]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:41 smithi136 ceph-mon[25618]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:42.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:41 smithi088 ceph-mon[24736]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:41 smithi088 ceph-mon[29649]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:43.914 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:43 smithi088 ceph-mon[29649]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:43.914 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:43 smithi088 ceph-mon[24736]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:44.088 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:43 smithi136 ceph-mon[25618]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:44.088 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:33:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:33:44] "GET /metrics HTTP/1.1" 200 37894 "" "Prometheus/2.33.4" 2024-05-25T05:33:45.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:44 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:46.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:45 smithi136 ceph-mon[25618]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:46.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:45 smithi088 ceph-mon[29649]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:46.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:45 smithi088 ceph-mon[24736]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:47 smithi136 ceph-mon[25618]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:48.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:47 smithi088 ceph-mon[24736]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:48.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:47 smithi088 ceph-mon[29649]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:49 smithi136 ceph-mon[25618]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:50.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:49 smithi088 ceph-mon[24736]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:50.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:49 smithi088 ceph-mon[29649]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:51 smithi136 ceph-mon[25618]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:52.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:51 smithi088 ceph-mon[24736]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:52.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:52.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:51 smithi088 ceph-mon[29649]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:52.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:33:54.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:33:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:33:54] "GET /metrics HTTP/1.1" 200 37917 "" "Prometheus/2.33.4" 2024-05-25T05:33:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:53 smithi136 ceph-mon[25618]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:33:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:33:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:33:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:53 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:54.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[24736]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:54.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[29649]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:33:54.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:53 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:33:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:54 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:55.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:54 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:54 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:33:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:55 smithi136 ceph-mon[25618]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:56.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:55 smithi088 ceph-mon[29649]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:55 smithi088 ceph-mon[24736]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:57 smithi136 ceph-mon[25618]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:58.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:57 smithi088 ceph-mon[29649]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:33:58.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:57 smithi088 ceph-mon[24736]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:00.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:33:59 smithi136 ceph-mon[25618]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:00.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:33:59 smithi088 ceph-mon[29649]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:33:59 smithi088 ceph-mon[24736]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:02.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:01 smithi088 ceph-mon[29649]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:02.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:01 smithi088 ceph-mon[24736]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:01 smithi136 ceph-mon[25618]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:04.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:03 smithi088 ceph-mon[29649]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:04.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:03 smithi088 ceph-mon[24736]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:03 smithi136 ceph-mon[25618]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:04.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:34:04] "GET /metrics HTTP/1.1" 200 37917 "" "Prometheus/2.33.4" 2024-05-25T05:34:05.002 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.003 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.004 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.004 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.004 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:04 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:04 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:04 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:05.981 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:05 smithi088 ceph-mon[24736]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:05.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:05 smithi088 ceph-mon[29649]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:05 smithi136 ceph-mon[25618]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:07.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:06 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:07.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:06 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:07.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:06 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:07 smithi136 ceph-mon[25618]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:08.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:07 smithi088 ceph-mon[29649]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:08.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:07 smithi088 ceph-mon[24736]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:10.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:09 smithi088 ceph-mon[29649]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:10.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:09 smithi088 ceph-mon[24736]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:09 smithi136 ceph-mon[25618]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:11 smithi088 ceph-mon[29649]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:11 smithi088 ceph-mon[24736]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:11 smithi136 ceph-mon[25618]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:14.186 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:13 smithi136 ceph-mon[25618]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:14.187 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:14 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:34:14] "GET /metrics HTTP/1.1" 200 37916 "" "Prometheus/2.33.4" 2024-05-25T05:34:14.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:13 smithi088 ceph-mon[29649]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:14.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:13 smithi088 ceph-mon[24736]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:15.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:14 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:14 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:15.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:14 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:16.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:15 smithi088 ceph-mon[24736]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:15 smithi088 ceph-mon[29649]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:16.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:15 smithi136 ceph-mon[25618]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:18.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:17 smithi088 ceph-mon[24736]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:18.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:17 smithi088 ceph-mon[29649]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:17 smithi136 ceph-mon[25618]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:20.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:19 smithi088 ceph-mon[24736]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:19 smithi088 ceph-mon[29649]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:19 smithi136 ceph-mon[25618]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:22.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:21 smithi088 ceph-mon[29649]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:22.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:21 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:21 smithi088 ceph-mon[24736]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:21 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:22.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:21 smithi136 ceph-mon[25618]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:22.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:21 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:24.209 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:23 smithi136 ceph-mon[25618]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:24.210 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:34:24] "GET /metrics HTTP/1.1" 200 37914 "" "Prometheus/2.33.4" 2024-05-25T05:34:24.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:23 smithi088 ceph-mon[24736]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:24.336 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:23 smithi088 ceph-mon[29649]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:25.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:24 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:25.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.021 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.022 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.022 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:24 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:25.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:24 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:25 smithi088 ceph-mon[24736]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:25 smithi088 ceph-mon[29649]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:26.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:25 smithi136 ceph-mon[25618]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:27.119 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:26 smithi088 ceph-mon[29649]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:27.119 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:26 smithi088 ceph-mon[24736]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:27.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:26 smithi136 ceph-mon[25618]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:30.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:29 smithi088 ceph-mon[29649]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:29 smithi088 ceph-mon[24736]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:30.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:29 smithi136 ceph-mon[25618]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:32.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:31 smithi088 ceph-mon[29649]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:31 smithi088 ceph-mon[24736]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:31 smithi136 ceph-mon[25618]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:34.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:33 smithi088 ceph-mon[24736]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:34.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:33 smithi088 ceph-mon[29649]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:34.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:33 smithi136 ceph-mon[25618]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:34.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:34:34] "GET /metrics HTTP/1.1" 200 37914 "" "Prometheus/2.33.4" 2024-05-25T05:34:35.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:34 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:35.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:34 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:35.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:34 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:36.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:35 smithi136 ceph-mon[25618]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:35 smithi088 ceph-mon[29649]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:35 smithi088 ceph-mon[24736]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:37.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:36 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:36 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:37.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:36 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:37 smithi136 ceph-mon[25618]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:37 smithi088 ceph-mon[24736]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:37 smithi088 ceph-mon[29649]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:39.996 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:39 smithi088 ceph-mon[24736]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:39.996 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:39 smithi088 ceph-mon[29649]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:40.026 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:34:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:39 smithi136 ceph-mon[25618]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:42.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:41 smithi088 ceph-mon[24736]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:42.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:41 smithi088 ceph-mon[29649]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 17s ago 26m - - 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 17s ago 25m - - 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (12m) 17s ago 20m 21.9M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (12m) 17s ago 20m 54.6M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (2m) 17s ago 19m 50.8M - 3.5 e1d6a67b021e 745ae4a2010f 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283 running (15m) 17s ago 25m 511M - 19.0.0-2843-gea0684c0 f9a9809cafd6 1d0d66e6da75 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (9m) 17s ago 26m 452M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (27m) 17s ago 27m 82.2M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (25m) 17s ago 25m 59.7M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:34:42.067 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (25m) 17s ago 25m 55.1M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (12m) 17s ago 21m 17.5M - 1.3.1 1dbe0e931976 a11a34b18e29 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (12m) 17s ago 21m 18.5M - 1.3.1 1dbe0e931976 85883e864814 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (25m) 17s ago 25m 53.8M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (24m) 17s ago 24m 54.6M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (24m) 17s ago 24m 50.0M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (23m) 17s ago 23m 56.2M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (23m) 17s ago 23m 54.2M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (23m) 17s ago 23m 51.3M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (22m) 17s ago 22m 53.0M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (22m) 17s ago 22m 53.7M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (2m) 17s ago 21m 72.7M - 2.33.4 514e6a882f6e c328bce93da9 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (20m) 17s ago 20m 76.3M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:34:42.068 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (19m) 17s ago 19m 77.4M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:34:42.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:41 smithi136 ceph-mon[25618]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:42.873 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ls' 2024-05-25T05:34:44.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:43 smithi136 ceph-mon[25618]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:43 smithi136 ceph-mon[25618]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:44.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:34:44] "GET /metrics HTTP/1.1" 200 37918 "" "Prometheus/2.33.4" 2024-05-25T05:34:44.226 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:43 smithi088 ceph-mon[24736]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:44.226 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:43 smithi088 ceph-mon[24736]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:44.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:43 smithi088 ceph-mon[29649]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:34:44.226 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:43 smithi088 ceph-mon[29649]: from='client.15396 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:44.941 INFO:teuthology.orchestra.run.smithi088.stdout:NAME PORTS RUNNING REFRESHED AGE PLACEMENT 2024-05-25T05:34:44.950 INFO:teuthology.orchestra.run.smithi088.stdout:agent 2/2 0s ago 3m * 2024-05-25T05:34:44.950 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager ?:9093,9094 1/1 0s ago 22m smithi088=a;count:1 2024-05-25T05:34:44.950 INFO:teuthology.orchestra.run.smithi088.stdout:grafana ?:3000 1/1 0s ago 21m smithi136=a;count:1 2024-05-25T05:34:44.950 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo ?:5000 1/1 0s ago 19m count:1 2024-05-25T05:34:44.951 INFO:teuthology.orchestra.run.smithi088.stdout:mgr 2/2 0s ago 25m smithi088=y;smithi136=x;count:2 2024-05-25T05:34:44.951 INFO:teuthology.orchestra.run.smithi088.stdout:mon 3/3 0s ago 25m smithi088:172.21.15.88=a;smithi088:[v2:172.21.15.88:3301,v1:172.21.15.88:6790]=c;smithi136:172.21.15.136=b;count:3 2024-05-25T05:34:44.951 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter ?:9100 2/2 0s ago 22m smithi088=a;smithi136=b;count:2 2024-05-25T05:34:44.951 INFO:teuthology.orchestra.run.smithi088.stdout:osd 8 0s ago - 2024-05-25T05:34:44.951 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus ?:9095 1/1 0s ago 22m smithi136=a;count:1 2024-05-25T05:34:44.951 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo ?:8000 2/2 0s ago 20m count:2 2024-05-25T05:34:45.130 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:44 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:45.131 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.131 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.131 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:44 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:44 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[29649]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[24736]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:45.937 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:45 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:46.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:45 smithi136 ceph-mon[25618]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:46.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:45 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:46.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:45 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:46.119 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:45 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:46.263 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions' 2024-05-25T05:34:47.013 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:46 smithi088 ceph-mon[24736]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:47.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:46 smithi088 ceph-mon[29649]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:47.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:46 smithi136 ceph-mon[25618]: from='client.15402 -' entity='client.admin' cmd=[{"prefix": "orch ls", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:48.027 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:47 smithi088 ceph-mon[29649]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:48.027 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:47 smithi088 ceph-mon[24736]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:48.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:47 smithi136 ceph-mon[25618]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 97 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:34:49.905 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:34:49.905 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:34:49.905 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:34:49.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:49.905 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:34:49.905 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:34:49.905 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:34:49.906 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:34:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:49 smithi136 ceph-mon[25618]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-05-25T05:34:50.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:49 smithi088 ceph-mon[24736]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-05-25T05:34:50.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:49 smithi088 ceph-mon[29649]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-05-25T05:34:50.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mgr' 2024-05-25T05:34:51.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:50 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1724442731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:34:51.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:50 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1724442731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:34:51.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:50 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1724442731' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:34:52.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:51 smithi088 ceph-mon[29649]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-05-25T05:34:52.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:51 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:52.055 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:51 smithi088 ceph-mon[24736]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-05-25T05:34:52.055 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:51 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:51 smithi136 ceph-mon[25618]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 98 MiB used, 715 GiB / 715 GiB avail; 41 KiB/s rd, 0 B/s wr, 67 op/s 2024-05-25T05:34:52.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:51 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[24736]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[24736]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[29649]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[29649]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:54.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:54.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:34:54.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:34:54.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:53 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:54.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:53 smithi136 ceph-mon[25618]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:34:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:53 smithi136 ceph-mon[25618]: from='client.15414 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mgr", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:34:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:53 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:34:54.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:53 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:54.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ::ffff:172.21.15.136 - - [25/May/2024:05:34:54] "GET /metrics HTTP/1.1" 200 37917 "" "Prometheus/2.33.4" 2024-05-25T05:34:54.637 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:34:55.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:54 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:54 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:34:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:54 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:34:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:54 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:55.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:55.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:55.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:55.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:34:55.295 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:34:55.295 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:55.295 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:34:55.295 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:55.295 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:55.295 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:34:55.296 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:34:55.296 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:54 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:55.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-05-25T05:34:56.116 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:55 smithi088 ceph-mon[24736]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:34:56.116 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:55 smithi088 ceph-mon[24736]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:34:56.116 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:55 smithi088 ceph-mon[24736]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:34:56.116 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:55 smithi088 ceph-mon[29649]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:34:56.116 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:55 smithi088 ceph-mon[29649]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:34:56.117 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:55 smithi088 ceph-mon[29649]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:34:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:55 smithi136 ceph-mon[25618]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:34:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:55 smithi136 ceph-mon[25618]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:34:56.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:55 smithi136 ceph-mon[25618]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:34:57.564 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:34:58.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:57 smithi088 ceph-mon[29649]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:34:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:57 smithi088 ceph-mon[24736]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:34:58.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:57 smithi136 ceph-mon[25618]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 72 KiB/s rd, 0 B/s wr, 119 op/s 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 13s ago 26m - - 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 13s ago 26m - - 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (12m) 13s ago 21m 21.9M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (12m) 13s ago 20m 55.0M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (3m) 13s ago 19m 50.8M - 3.5 e1d6a67b021e 745ae4a2010f 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283 running (15m) 13s ago 25m 512M - 19.0.0-2843-gea0684c0 f9a9809cafd6 1d0d66e6da75 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (9m) 13s ago 27m 452M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:34:58.230 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (27m) 13s ago 27m 83.1M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (25m) 13s ago 25m 59.8M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (26m) 13s ago 26m 55.7M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (13m) 13s ago 21m 17.8M - 1.3.1 1dbe0e931976 a11a34b18e29 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (12m) 13s ago 21m 18.4M - 1.3.1 1dbe0e931976 85883e864814 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (25m) 13s ago 25m 53.9M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (24m) 13s ago 24m 54.7M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (24m) 13s ago 24m 50.0M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (24m) 13s ago 24m 56.3M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (23m) 13s ago 23m 54.2M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (23m) 13s ago 23m 51.3M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (23m) 13s ago 23m 53.0M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (22m) 13s ago 22m 53.7M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:34:58.231 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (3m) 13s ago 22m 72.7M - 2.33.4 514e6a882f6e c328bce93da9 2024-05-25T05:34:58.232 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (20m) 13s ago 20m 76.4M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:34:58.232 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (20m) 13s ago 20m 77.5M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:34:58.633 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:34:58.633 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:34:58.633 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:34:58.633 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:58.633 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:34:58.634 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Doing first pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 image", 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:34:58.969 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:34:59.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-25T05:34:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-25T05:34:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:34:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:58 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2518916109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:34:59.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2518916109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:34:59.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: from='client.15420 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:59.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: from='client.15426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:34:59.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' 2024-05-25T05:34:59.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:34:59.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: from='mgr.24980 172.21.15.136:0/1959090135' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-25T05:34:59.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd=[{"prefix": "mgr fail", "who": "x"}]: dispatch 2024-05-25T05:34:59.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:34:59.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:58 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2518916109' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:34:59.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:34:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:34:59] ENGINE Bus STOPPING 2024-05-25T05:34:59.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:34:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:34:59] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:34:59.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:34:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:34:59] ENGINE Bus STOPPED 2024-05-25T05:34:59.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:34:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:34:59] ENGINE Bus STARTING 2024-05-25T05:34:59.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:34:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:34:59] ENGINE Serving on http://:::9283 2024-05-25T05:34:59.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:34:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:34:59] ENGINE Bus STARTED 2024-05-25T05:34:59.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:34:59.477+0000 7fac8fdf6700 -1 mgr handle_mgr_map I was active but no longer am 2024-05-25T05:34:59.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ignoring --setuser ceph since I am not root 2024-05-25T05:34:59.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: ignoring --setgroup ceph since I am not root 2024-05-25T05:34:59.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mgr[50348]: -- 172.21.15.136:0/3461249127 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x559f5b8865a0 con 0x559f5b85a800 2024-05-25T05:34:59.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:34:59.659+0000 7fbefebd4200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:34:59.843 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:34:59.843+0000 7fbefebd4200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:00.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:34:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:34:59.950+0000 7fbefebd4200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:35:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:35:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: Failing over to other MGR 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.24980 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: mgrmap e35: y(active, starting, since 0.997518s) 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:35:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:35:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: Manager daemon y is now available 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:35:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:35:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:35:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:35:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:35:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:34:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:00.257 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:35:00.257 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:00.257 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:35:00.257 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:35:00.257 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: Failing over to other MGR 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.24980 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: mgrmap e35: y(active, starting, since 0.997518s) 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:35:00.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: Manager daemon y is now available 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:00.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:00.260 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 73 KiB/s rd, 0 B/s wr, 120 op/s 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='client.15432 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: Upgrade: Need to upgrade myself (mgr.x) 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: Failing over to other MGR 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.24980 ' entity='mgr.x' cmd='[{"prefix": "mgr fail", "who": "x"}]': finished 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: mgrmap e35: y(active, starting, since 0.997518s) 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:35:00.261 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: Manager daemon y is now available 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:00.262 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:00.263 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:34:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:00.558 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:00.280+0000 7fbefebd4200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:35:00.559 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:00.373+0000 7fbefebd4200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: [25/May/2024:05:34:59] ENGINE Bus STARTING 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: mgrmap e36: y(active, since 2s) 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: [25/May/2024:05:34:59] ENGINE Bus STARTING 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: mgrmap e36: y(active, since 2s) 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:35:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:35:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: [25/May/2024:05:34:59] ENGINE Bus STARTING 2024-05-25T05:35:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: mgrmap e36: y(active, since 2s) 2024-05-25T05:35:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.868 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:01.709+0000 7fbefebd4200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:35:01.939 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: [25/May/2024:05:35:00] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:35:01.939 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: [25/May/2024:05:35:00] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:35:01.939 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: [25/May/2024:05:35:00] ENGINE Bus STARTED 2024-05-25T05:35:01.939 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:35:01.939 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:35:01.939 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:01.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: [25/May/2024:05:35:00] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: [25/May/2024:05:35:00] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: [25/May/2024:05:35:00] ENGINE Bus STARTED 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:01.941 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:01.942 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:01.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:01.907+0000 7fbefebd4200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:02.092+0000 7fbefebd4200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: [25/May/2024:05:35:00] ENGINE Serving on https://172.21.15.88:7150 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: [25/May/2024:05:35:00] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: [25/May/2024:05:35:00] ENGINE Bus STARTED 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:35:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:02.734 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:02.417+0000 7fbefebd4200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:35:02.734 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:02.518+0000 7fbefebd4200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:35:03.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:02.733+0000 7fbefebd4200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:35:03.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:02.946+0000 7fbefebd4200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:03.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:02 smithi136 ceph-mon[25618]: mgrmap e37: y(active, since 3s) 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.268 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[29649]: mgrmap e37: y(active, since 3s) 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:03.269 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:02 smithi088 ceph-mon[24736]: mgrmap e37: y(active, since 3s) 2024-05-25T05:35:03.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:03.557+0000 7fbefebd4200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:35:04.330 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:04.020+0000 7fbefebd4200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:35:04.330 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:04.125+0000 7fbefebd4200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:35:04.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:04.329+0000 7fbefebd4200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.695 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:04.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: from='client.15348 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:04.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:04.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:05.115 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:04.878+0000 7fbefebd4200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:35:05.115 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:04.977+0000 7fbefebd4200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:35:05.377 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:05 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:05.235+0000 7fbefebd4200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:35:05.377 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:05 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:05.376+0000 7fbefebd4200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:35:05.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:05 smithi136 ceph-mon[25618]: mgrmap e38: y(active, since 5s) 2024-05-25T05:35:05.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:05 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:05.480+0000 7fbefebd4200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:35:05.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:05 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:05.608+0000 7fbefebd4200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:05.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:05 smithi088 ceph-mon[29649]: mgrmap e38: y(active, since 5s) 2024-05-25T05:35:05.682 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:05 smithi088 ceph-mon[24736]: mgrmap e38: y(active, since 5s) 2024-05-25T05:35:06.248 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:05 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:05.928+0000 7fbefebd4200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:35:06.551 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:06 smithi136 ceph-mon[25618]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:06.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:06 smithi088 ceph-mon[24736]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:06.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:06 smithi088 ceph-mon[29649]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:35:06.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:06.551+0000 7fbefebd4200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:35:06.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:06.785+0000 7fbefebd4200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:35:06.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:35:06] ENGINE Bus STARTING 2024-05-25T05:35:07.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: CherryPy Checker: 2024-05-25T05:35:07.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: The Application mounted at '' has an empty config. 2024-05-25T05:35:07.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: 2024-05-25T05:35:07.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:35:06] ENGINE Serving on http://:::9283 2024-05-25T05:35:07.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[50344]: [25/May/2024:05:35:06] ENGINE Bus STARTED 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:07.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:07.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:07 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:35:07.542+0000 7f820acbb700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Creating ceph-iscsi config... 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return _run_code(code, main_globals, None, 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: exec(code, run_globals) 2024-05-25T05:35:07.790 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:07.791 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return future.result(timeout) 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return self.__get_result() 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: raise self._exception 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: use_current_daemon_image=reconfig, 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Creating ceph-iscsi config... 2024-05-25T05:35:07.792 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return _run_code(code, main_globals, None, 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: exec(code, run_globals) 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:07.793 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:07.794 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:07.794 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:07.794 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:07.794 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:07 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:35:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:07 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/629001912' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[29649]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[29649]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.807 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.808 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: return future.result(timeout) 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.__get_result() 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: raise self._exception 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:35:08.809 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:08.810 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[29649]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[29649]: mgrmap e39: y(active, since 9s), standbys: x 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:35:08.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[29649]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[24736]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[24736]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:08.812 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:08.813 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: return future.result(timeout) 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.__get_result() 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: raise self._exception 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:08.814 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:08.815 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[24736]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[24736]: mgrmap e39: y(active, since 9s), standbys: x 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:35:08.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:08 smithi088 ceph-mon[24736]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:08 smithi136 ceph-mon[25618]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:08 smithi136 ceph-mon[25618]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:35:09.135 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:35:09.136 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return future.result(timeout) 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.__get_result() 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: raise self._exception 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:09.137 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:09.138 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:08 smithi136 ceph-mon[25618]: Reconfiguring prometheus.a (dependencies changed)... 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:08 smithi136 ceph-mon[25618]: mgrmap e39: y(active, since 9s), standbys: x 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:35:09.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:08 smithi136 ceph-mon[25618]: Reconfiguring daemon prometheus.a on smithi136 2024-05-25T05:35:10.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:10 smithi136 ceph-mon[25618]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:35:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[29649]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:35:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:10 smithi088 ceph-mon[24736]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 bash[71137]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.348Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:35:11.625 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:35:11.626 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-25T05:35:11.626 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[66814]: ts=2024-05-25T05:35:11.349Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-25T05:35:11.626 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 podman[71151]: 2024-05-25 05:35:11.358997174 +0000 UTC m=+0.108855575 container died c328bce93da9adab72548d23b497994dcc3aa8079d58703cf5edf1053d8e62bb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:35:11.884 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 podman[71151]: 2024-05-25 05:35:11.731957783 +0000 UTC m=+0.481816189 container cleanup c328bce93da9adab72548d23b497994dcc3aa8079d58703cf5edf1053d8e62bb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:35:11.884 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 bash[71151]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:35:11.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:11 smithi136 bash[71178]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus.a" found: no such container 2024-05-25T05:35:12.268 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 podman[71163]: 2024-05-25 05:35:12.008844482 +0000 UTC m=+0.651218431 container remove c328bce93da9adab72548d23b497994dcc3aa8079d58703cf5edf1053d8e62bb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:35:12.268 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-25T05:35:12.268 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 systemd[1]: Stopped Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:12.268 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Consumed 1.387s CPU time. 2024-05-25T05:35:12.268 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 systemd[1]: Starting Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:12.268 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 podman[71246]: 2024-05-25 05:35:12.156421488 +0000 UTC m=+0.019242572 image pull 514e6a882f6e74806a5856468489eeff8d7106095557578da96935e4d0ba4d9d quay.io/prometheus/prometheus:v2.33.4 2024-05-25T05:35:12.268 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 podman[71246]: 2024-05-25 05:35:12.268291146 +0000 UTC m=+0.131112266 container create a3c4b9bf75f8f0435a8329e35a602c5f1f619256032e73fa56063129cb0e1cfb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:35:12.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 podman[71246]: 2024-05-25 05:35:12.512383837 +0000 UTC m=+0.375204911 container init a3c4b9bf75f8f0435a8329e35a602c5f1f619256032e73fa56063129cb0e1cfb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:35:12.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 podman[71246]: 2024-05-25 05:35:12.515285491 +0000 UTC m=+0.378106567 container start a3c4b9bf75f8f0435a8329e35a602c5f1f619256032e73fa56063129cb0e1cfb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:35:12.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:12 smithi088 ceph-mon[29649]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:35:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:12 smithi088 ceph-mon[24736]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:35:12.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:12 smithi136 ceph-mon[25618]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 19 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:35:12.884 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.539Z caller=main.go:475 level=info msg="No time or size retention was set so using the default time retention" duration=15d 2024-05-25T05:35:12.884 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.539Z caller=main.go:512 level=info msg="Starting Prometheus" version="(version=2.33.4, branch=HEAD, revision=83032011a5d3e6102624fe58241a374a7201fee8)" 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.539Z caller=main.go:517 level=info build_context="(go=go1.17.7, user=root@d13bf69e7be8, date=20220222-16:51:28)" 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.539Z caller=main.go:518 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.539Z caller=main.go:519 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.539Z caller=main.go:520 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.541Z caller=web.go:570 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.542Z caller=main.go:923 level=info msg="Starting TSDB ..." 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.542Z caller=tls_config.go:195 level=info component=web msg="TLS is disabled." http2=false 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.545Z caller=head.go:493 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.545Z caller=head.go:527 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.948µs 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.545Z caller=head.go:533 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:12.546Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=5 2024-05-25T05:35:12.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 bash[71246]: a3c4b9bf75f8f0435a8329e35a602c5f1f619256032e73fa56063129cb0e1cfb 2024-05-25T05:35:12.886 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:12 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:13.267 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.005Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=5 2024-05-25T05:35:13.267 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.232Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=5 2024-05-25T05:35:13.574 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.288Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=5 2024-05-25T05:35:13.574 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.292Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=5 2024-05-25T05:35:13.574 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.292Z caller=head.go:604 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=5 2024-05-25T05:35:13.574 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.292Z caller=head.go:610 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=43.823µs wal_replay_duration=746.975541ms total_replay_duration=747.033682ms 2024-05-25T05:35:13.574 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.296Z caller=main.go:944 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:35:13.574 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.296Z caller=main.go:947 level=info msg="TSDB started" 2024-05-25T05:35:13.574 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.296Z caller=main.go:1128 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:35:13.575 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.316Z caller=main.go:1165 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.96531ms db_storage=827ns remote_storage=1.611µs web_handler=402ns query_engine=971ns scrape=388.834µs scrape_sd=99.597µs notify=10.855µs notify_sd=14.368µs rules=19.10152ms 2024-05-25T05:35:13.575 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:35:13 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:35:13.316Z caller=main.go:896 level=info msg="Server is ready to receive web requests." 2024-05-25T05:35:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:13.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:35:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:13 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:35:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:35:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:14.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:14 smithi136 ceph-mon[25618]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:14.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:14.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:14.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:14.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:15.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[24736]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[29649]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:15.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:16.107 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:15 smithi136 ceph-mon[25618]: Upgrade: Updating mgr.x 2024-05-25T05:35:16.107 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:15 smithi136 ceph-mon[25618]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:16.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:15 smithi088 ceph-mon[29649]: Upgrade: Updating mgr.x 2024-05-25T05:35:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:15 smithi088 ceph-mon[29649]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:15 smithi088 ceph-mon[24736]: Upgrade: Updating mgr.x 2024-05-25T05:35:16.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:15 smithi088 ceph-mon[24736]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:16.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:16 smithi136 systemd[1]: Stopping Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:16.697 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:16 smithi136 podman[71596]: 2024-05-25 05:35:16.43737509 +0000 UTC m=+0.163452604 container died 1d0d66e6da757a336e9adaac790c6df36bb5e09f499416a276c7624acd0e84b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-ea0684c, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , ceph=True, GIT_CLEAN=True, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:35:17.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:16 smithi136 ceph-mon[25618]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:17.099 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:16 smithi136 podman[71596]: 2024-05-25 05:35:16.780974578 +0000 UTC m=+0.507052095 container cleanup 1d0d66e6da757a336e9adaac790c6df36bb5e09f499416a276c7624acd0e84b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-ea0684c, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True) 2024-05-25T05:35:17.099 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:16 smithi136 bash[71596]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x 2024-05-25T05:35:17.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:16 smithi088 ceph-mon[29649]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:17.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:16 smithi088 ceph-mon[24736]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:17.369 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 podman[71611]: 2024-05-25 05:35:17.099237172 +0000 UTC m=+0.662756107 container remove 1d0d66e6da757a336e9adaac790c6df36bb5e09f499416a276c7624acd0e84b6 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, RELEASE=squid-ea0684c, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_CLEAN=True) 2024-05-25T05:35:17.369 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:35:17.369 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-05-25T05:35:17.370 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 systemd[1]: Stopped Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:17.370 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Consumed 1min 1.949s CPU time. 2024-05-25T05:35:17.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 systemd[1]: Starting Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:17.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 podman[71739]: 2024-05-25 05:35:17.683991259 +0000 UTC m=+0.110500550 container create abbe164eda6f1be2e85e1941d47de91873a596a22b3ae3480ec4c940bd31fa37 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , RELEASE=squid-ea0684c, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-25T05:35:17.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 podman[71739]: 2024-05-25 05:35:17.5912074 +0000 UTC m=+0.017716703 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:35:17.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 podman[71739]: 2024-05-25 05:35:17.919646056 +0000 UTC m=+0.346155348 container init abbe164eda6f1be2e85e1941d47de91873a596a22b3ae3480ec4c940bd31fa37 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_CLEAN=True, ceph=True, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:35:17.947 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 podman[71739]: 2024-05-25 05:35:17.922697294 +0000 UTC m=+0.349206599 container start abbe164eda6f1be2e85e1941d47de91873a596a22b3ae3480ec4c940bd31fa37 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ea0684c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:35:18.268 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:17 smithi136 ceph-mgr[71757]: -- 172.21.15.136:0/1376016552 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x56532b4925a0 con 0x56532b466800 2024-05-25T05:35:18.268 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:18 smithi136 bash[71739]: abbe164eda6f1be2e85e1941d47de91873a596a22b3ae3480ec4c940bd31fa37 2024-05-25T05:35:18.268 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:18 smithi136 systemd[1]: Started Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:18.268 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:18.077+0000 7fc3b7605200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:35:18.268 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:18.267+0000 7fc3b7605200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:18.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:18.371+0000 7fc3b7605200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:35:18.883 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:18.883 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:18.883 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:18.883 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:18.884 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:18.885 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:18.885 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:18.885 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:18.885 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:18.885 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:19.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:18.683+0000 7fc3b7605200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:35:19.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:18 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:18.769+0000 7fc3b7605200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:19.854 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:19.854 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:19.854 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:19.854 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3530807036' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:35:19.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:19.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:19.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:19.855 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:19 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3530807036' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:35:20.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:19 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:19.982+0000 7fc3b7605200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:35:20.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:19 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:20.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:19 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:20.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:19 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:20.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:19 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3530807036' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:35:20.623 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:20.155+0000 7fc3b7605200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:20.623 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:20.329+0000 7fc3b7605200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:35:20.623 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:20.623+0000 7fc3b7605200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:35:20.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:20 smithi136 ceph-mon[25618]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-25T05:35:20.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:20.718+0000 7fc3b7605200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:35:21.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:20 smithi088 ceph-mon[24736]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-25T05:35:21.177 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:20 smithi088 ceph-mon[29649]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 170 B/s rd, 0 op/s 2024-05-25T05:35:21.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:20.935+0000 7fc3b7605200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:35:21.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:21.132+0000 7fc3b7605200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:35:21.466+0000 7f820acbb700 -1 log_channel(cephadm) log [ERR] : cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Creating ceph-iscsi config... 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return _run_code(code, main_globals, None, 2024-05-25T05:35:21.808 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: exec(code, run_globals) 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:21.809 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:21.810 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return future.result(timeout) 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return self.__get_result() 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: raise self._exception 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: use_current_daemon_image=reconfig, 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Creating ceph-iscsi config... 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:21.811 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: Traceback (most recent call last): 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: return _run_code(code, main_globals, None, 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: exec(code, run_globals) 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:21.812 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:21.813 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:21.813 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:21.813 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:22.072 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:21 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:21.756+0000 7fc3b7605200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:35:22.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:22.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:22.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:22.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:22.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:22.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:22.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:22.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]: dispatch 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.y"}]': finished 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.iscsi.foo.smithi088.khxvsc", "caps": ["mon", "profile rbd, allow command \"osd blocklist\", allow command \"config-key get\" with \"key\" prefix \"iscsi/\"", "mgr", "allow command \"service status\"", "osd", "allow rwx"]}]: dispatch 2024-05-25T05:35:22.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:22.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:22.205+0000 7fc3b7605200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:35:22.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:22.305+0000 7fc3b7605200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:35:22.830 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:22 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:22.532+0000 7fc3b7605200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:35:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[24736]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: return future.result(timeout) 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: return self.__get_result() 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout: raise self._exception 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[29649]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:23.093 INFO:journalctl@ceph.mon.c.smithi088.stdout: return future.result(timeout) 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: return self.__get_result() 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: raise self._exception 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:23.094 INFO:journalctl@ceph.mon.c.smithi088.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: exec(code, run_globals) 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:23.095 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all mgr 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[24736]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[24736]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[24736]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:23.096 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all mgr 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[29649]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[29649]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:23.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:22 smithi088 ceph-mon[29649]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:22 smithi136 ceph-mon[25618]: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:23.098 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.099 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1114, in _check_daemons 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: self.mgr._daemon_action(daemon_spec, action=action) 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 2457, in _daemon_action 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: CephadmServe(self)._create_daemon(daemon_spec, reconfig=(action == 'reconfig'))) 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/module.py", line 779, in wait_async 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.event_loop.get_result(coro, timeout) 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/ssh.py", line 136, in get_result 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: return future.result(timeout) 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 432, in result 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: return self.__get_result() 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/lib64/python3.6/concurrent/futures/_base.py", line 384, in __get_result 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: raise self._exception 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1377, in _create_daemon 2024-05-25T05:35:23.100 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_current_daemon_image=reconfig, 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/share/ceph/mgr/cephadm/serve.py", line 1692, in _run_cephadm 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: f'cephadm exited with an error code: {code}, stderr: {err}') 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: orchestrator._interface.OrchestratorError: cephadm exited with an error code: 1, stderr: Reconfig daemon iscsi.foo.smithi088.khxvsc ... 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: Creating ceph-iscsi config... 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/iscsi-gateway.cfg 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: Write file: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/iscsi.foo.smithi088.khxvsc/tcmu-runner-entrypoint.sh 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: Non-zero exit code 1 from systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: systemctl: stderr See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: Traceback (most recent call last): 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 197, in _run_module_as_main 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: return _run_code(code, main_globals, None, 2024-05-25T05:35:23.101 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/usr/lib64/python3.9/runpy.py", line 87, in _run_code 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: exec(code, run_globals) 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5618, in 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 5606, in main 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3096, in command_deploy_from 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3131, in _common_deploy 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 3151, in _deploy_daemon_container 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/__main__.py", line 1123, in deploy_daemon 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: File "/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/cephadm.c78258a9946c350e44c9d652c4770e8895f8ed367a8290dd8611f4d0daaeccc5/cephadmlib/call_wrappers.py", line 307, in call_throws 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: RuntimeError: Failed command: systemctl restart ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc: Job for ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service failed because the control process exited with error code. 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout: See "systemctl status ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" and "journalctl -xeu ceph-9a885618-1a54-11ef-bc9b-c7b262605968@iscsi.foo.smithi088.khxvsc.service" for details. 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:22 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all mgr 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:22 smithi136 ceph-mon[25618]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 426 B/s rd, 0 op/s 2024-05-25T05:35:23.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:23.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:22 smithi136 ceph-mon[25618]: Reconfiguring iscsi.foo.smithi088.khxvsc (dependencies changed)... 2024-05-25T05:35:23.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:22 smithi136 ceph-mon[25618]: Reconfiguring daemon iscsi.foo.smithi088.khxvsc on smithi088 2024-05-25T05:35:23.372 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:23.101+0000 7fc3b7605200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:35:23.372 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:23.200+0000 7fc3b7605200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:35:23.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:23.462+0000 7fc3b7605200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:35:23.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:23.615+0000 7fc3b7605200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:35:24.099 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:23.724+0000 7fc3b7605200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:35:24.099 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:23 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:23.867+0000 7fc3b7605200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:24.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:35:24] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.33.4" 2024-05-25T05:35:24.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:24.197+0000 7fc3b7605200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:35:25.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:24 smithi088 ceph-mon[24736]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:25.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:24 smithi088 ceph-mon[29649]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:25.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:24 smithi136 ceph-mon[25618]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:25.104 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:24 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:24.828+0000 7fc3b7605200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:35:25.105 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:25.059+0000 7fc3b7605200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:35:25.105 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: [25/May/2024:05:35:25] ENGINE Bus STARTING 2024-05-25T05:35:25.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: CherryPy Checker: 2024-05-25T05:35:25.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: The Application mounted at '' has an empty config. 2024-05-25T05:35:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: 2024-05-25T05:35:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: [25/May/2024:05:35:25] ENGINE Serving on http://:::9283 2024-05-25T05:35:25.385 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[71753]: [25/May/2024:05:35:25] ENGINE Bus STARTED 2024-05-25T05:35:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[24736]: Standby manager daemon x restarted 2024-05-25T05:35:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:35:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:26.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[29649]: Standby manager daemon x restarted 2024-05-25T05:35:26.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:35:26.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:26.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:26.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:26.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:25 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:25 smithi136 ceph-mon[25618]: Standby manager daemon x restarted 2024-05-25T05:35:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:25 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:35:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:25 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:25 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:25 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:25 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/3978949466' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:26.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[24736]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:26.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[24736]: mgrmap e40: y(active, since 27s), standbys: x 2024-05-25T05:35:26.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:26.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:26.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:26.907 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[29649]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:26.907 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[29649]: mgrmap e40: y(active, since 27s), standbys: x 2024-05-25T05:35:26.907 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:26.907 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:26.907 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:27.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:26 smithi136 ceph-mon[25618]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:27.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:26 smithi136 ceph-mon[25618]: mgrmap e40: y(active, since 27s), standbys: x 2024-05-25T05:35:27.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:27.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:28.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:28.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:28.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:35:28.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:35:28.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:35:28.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:35:28.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:28.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:27 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3991138765' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:35:28.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3991138765' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard iscsi-gateway-list"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:35:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard set-iscsi-api-ssl-verification", "value": "true"}]: dispatch 2024-05-25T05:35:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:27 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3991138765' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "osd blocklist ls"}]: dispatch 2024-05-25T05:35:29.257 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:28 smithi136 ceph-mon[25618]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:29.257 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.257 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.258 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[24736]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:29.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.279 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[29649]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:29.279 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.279 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.279 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:29.325 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 0s ago 26m - - 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 1s ago 26m - - 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (13m) 0s ago 21m 21.9M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (13m) 1s ago 21m 55.1M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (3m) 0s ago 20m 51.1M - 3.5 e1d6a67b021e 745ae4a2010f 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (12s) 1s ago 26m 335M - 19.0.0-2843-gea0684c0 f9a9809cafd6 abbe164eda6f 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (10m) 0s ago 27m 502M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (27m) 0s ago 28m 84.9M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (26m) 1s ago 26m 61.9M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:35:30.029 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (26m) 0s ago 26m 59.6M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (13m) 0s ago 22m 17.6M - 1.3.1 1dbe0e931976 a11a34b18e29 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (13m) 1s ago 22m 18.5M - 1.3.1 1dbe0e931976 85883e864814 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (25m) 0s ago 25m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (25m) 0s ago 25m 55.8M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (25m) 0s ago 25m 50.4M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (24m) 0s ago 24m 56.2M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (24m) 1s ago 24m 56.7M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (23m) 1s ago 23m 52.1M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (23m) 1s ago 23m 54.6M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (23m) 1s ago 23m 55.0M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (17s) 1s ago 22m 55.2M - 2.33.4 514e6a882f6e a3c4b9bf75f8 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (20m) 0s ago 20m 76.9M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:35:30.030 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (20m) 1s ago 20m 77.9M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:35:30.434 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:35:30.435 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:35:30.436 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:35:30.436 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:35:30.436 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:35:30.436 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:35:30.436 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:35:30.436 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:35:30.773 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:35:30.773 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:35:30.774 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='client.25426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: Upgrade: Updating mgr.x 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='client.25432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1894086715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:30.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='client.25426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: Upgrade: Updating mgr.x 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:30.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:30.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:30.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='client.25432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:30.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1894086715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:30.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='client.25426 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 255 B/s rd, 0 op/s 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: Upgrade: Updating mgr.x 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='client.25432 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:30.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1894086715' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:30.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:31.720 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:31 smithi136 systemd[1]: Stopping Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:31.720 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:31 smithi136 ceph-mon[25618]: from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:31.720 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:31.720 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:31.720 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:31 smithi136 ceph-mon[25618]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:31.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[29649]: from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[29649]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:31.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[24736]: from='client.25438 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:31.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:31.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:31.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:31 smithi088 ceph-mon[24736]: from='client.15558 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:35:32.022 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:31 smithi136 podman[72965]: 2024-05-25 05:35:31.719721134 +0000 UTC m=+0.134130601 container died abbe164eda6f1be2e85e1941d47de91873a596a22b3ae3480ec4c940bd31fa37 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ea0684c, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_CLEAN=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD) 2024-05-25T05:35:32.339 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 podman[72965]: 2024-05-25 05:35:32.097015667 +0000 UTC m=+0.511425166 container cleanup abbe164eda6f1be2e85e1941d47de91873a596a22b3ae3480ec4c940bd31fa37 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ea0684c, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, ceph=True, GIT_BRANCH=HEAD, io.buildah.version=1.33.5) 2024-05-25T05:35:32.339 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 bash[72965]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x 2024-05-25T05:35:32.613 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:32 smithi136 ceph-mon[25618]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-25T05:35:32.613 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 podman[72976]: 2024-05-25 05:35:32.339624725 +0000 UTC m=+0.617497283 container remove abbe164eda6f1be2e85e1941d47de91873a596a22b3ae3480ec4c940bd31fa37 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, ceph=True, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_CLEAN=True) 2024-05-25T05:35:32.614 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:35:32.614 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-05-25T05:35:32.614 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 systemd[1]: Stopped Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:32.614 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Consumed 8.600s CPU time. 2024-05-25T05:35:32.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:32 smithi088 ceph-mon[29649]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-25T05:35:32.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:32 smithi088 ceph-mon[24736]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 597 B/s rd, 0 op/s 2024-05-25T05:35:32.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 systemd[1]: Starting Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:33.175 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 podman[73107]: 2024-05-25 05:35:32.827741355 +0000 UTC m=+0.017931178 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:35:33.176 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:32 smithi136 podman[73107]: 2024-05-25 05:35:32.957370948 +0000 UTC m=+0.147560763 container create 26fc2100498b533d96ef777951e89711b2e931021df1b30310d40433437ca290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., version=8, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, com.redhat.component=centos-stream-container, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.buildah.version=1.19.8, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-05-25T05:35:33.176 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 podman[73107]: 2024-05-25 05:35:33.151411373 +0000 UTC m=+0.341601173 container init 26fc2100498b533d96ef777951e89711b2e931021df1b30310d40433437ca290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, distribution-scope=public, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_CLEAN=True, release=754, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, io.buildah.version=1.19.8, version=8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-type=git) 2024-05-25T05:35:33.176 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 podman[73107]: 2024-05-25 05:35:33.154790759 +0000 UTC m=+0.344980556 container start 26fc2100498b533d96ef777951e89711b2e931021df1b30310d40433437ca290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, GIT_CLEAN=True, io.buildah.version=1.19.8, name=centos-stream, version=8, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, io.openshift.expose-services=, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0) 2024-05-25T05:35:33.434 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 ceph-mgr[73126]: -- 172.21.15.136:0/684064433 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) v1 ==== 194+0+0 (secure 0 0 0) 0x564c9f210340 con 0x564c9f1e9000 2024-05-25T05:35:33.434 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 bash[73107]: 26fc2100498b533d96ef777951e89711b2e931021df1b30310d40433437ca290 2024-05-25T05:35:33.434 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 systemd[1]: Started Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:33.434 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:33.298+0000 7f1538dc3000 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:35:33.434 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:33.432+0000 7f1538dc3000 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:33.858 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:33.536+0000 7f1538dc3000 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:35:33.858 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:33.857+0000 7f1538dc3000 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:35:34.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:33.944+0000 7f1538dc3000 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:35:34.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:35:34] "GET /metrics HTTP/1.1" 200 37912 "" "Prometheus/2.33.4" 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:34.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:34.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:34.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.479 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:35.197+0000 7f1538dc3000 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:35:35.479 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:35.391+0000 7f1538dc3000 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:35.479 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:35.479+0000 7f1538dc3000 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.480 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.481 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.482 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.483 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.484 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:35.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:35.817+0000 7f1538dc3000 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:35:36.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:35.920+0000 7f1538dc3000 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:35:36.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:36.026+0000 7f1538dc3000 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:35:36.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:36.306+0000 7f1538dc3000 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: pgmap v21: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:36.791+0000 7f1538dc3000 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:37.308+0000 7f1538dc3000 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:37.409+0000 7f1538dc3000 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:37.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:37.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:37.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:37.822 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:37.733+0000 7f1538dc3000 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:35:38.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:37.832+0000 7f1538dc3000 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:35:38.503 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:38.261+0000 7f1538dc3000 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:35:38.504 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:38.404+0000 7f1538dc3000 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:35:38.504 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:38.503+0000 7f1538dc3000 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:35:38.504 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.504 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:38.504 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.506 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:38.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:38.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:38.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:38.831 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:38.626+0000 7f1538dc3000 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:38.831 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:38.719+0000 7f1538dc3000 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:35:39.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:39.316+0000 7f1538dc3000 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:39.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:39.999 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:39.719+0000 7f1538dc3000 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:35:39.999 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: [25/May/2024:05:35:39] ENGINE Bus STARTING 2024-05-25T05:35:39.999 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: CherryPy Checker: 2024-05-25T05:35:39.999 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: The Application mounted at '' has an empty config. 2024-05-25T05:35:39.999 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: 2024-05-25T05:35:39.999 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: [25/May/2024:05:35:39] ENGINE Serving on http://:::9283 2024-05-25T05:35:39.999 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[73122]: [25/May/2024:05:35:39] ENGINE Bus STARTED 2024-05-25T05:35:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Standby manager daemon x restarted 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Standby manager daemon x restarted 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 767 B/s rd, 0 op/s 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Standby manager daemon x restarted 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/2' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:40.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:40.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:40.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:40.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: mgrmap e41: y(active, since 42s), standbys: x 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: mgrmap e41: y(active, since 42s), standbys: x 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: mgrmap e41: y(active, since 42s), standbys: x 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:41.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:41.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:41.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:41.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:41.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:42.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:43.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:43.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:35:44] "GET /metrics HTTP/1.1" 200 37912 "" "Prometheus/2.33.4" 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:44.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.743 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:44.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.747 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.749 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.752 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.753 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.754 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.755 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.756 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.757 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.758 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.758 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.758 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.758 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.758 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:45.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:45.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:45.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:45.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:45.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.582 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.582 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.583 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.584 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:48.338 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: Upgrade: Updating mgr.x 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:48.339 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[24736]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: Upgrade: Updating mgr.x 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:48.340 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:48.341 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:48 smithi088 ceph-mon[29649]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:48.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: Upgrade: Updating mgr.x 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:48.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:48 smithi136 ceph-mon[25618]: Deploying daemon mgr.x on smithi136 2024-05-25T05:35:51.011 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:50 smithi136 ceph-mon[25618]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:51.298 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:51 smithi136 systemd[1]: Stopping Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:51.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:50 smithi088 ceph-mon[29649]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:51.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:50 smithi088 ceph-mon[24736]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:51.591 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:51 smithi136 podman[78183]: 2024-05-25 05:35:51.297288876 +0000 UTC m=+0.140246796 container died 26fc2100498b533d96ef777951e89711b2e931021df1b30310d40433437ca290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, architecture=x86_64, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, name=centos-stream, build-date=2022-05-03T08:36:31.336870, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., RELEASE=HEAD, io.openshift.expose-services=, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-05-25T05:35:51.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:51 smithi136 podman[78183]: 2024-05-25 05:35:51.699764145 +0000 UTC m=+0.542722055 container cleanup 26fc2100498b533d96ef777951e89711b2e931021df1b30310d40433437ca290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_BRANCH=HEAD, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, vcs-type=git, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., version=8, GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, distribution-scope=public, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, ceph=True, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-25T05:35:51.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:51 smithi136 bash[78183]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x 2024-05-25T05:35:52.265 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:51 smithi136 podman[78195]: 2024-05-25 05:35:51.926112837 +0000 UTC m=+0.631275231 container remove 26fc2100498b533d96ef777951e89711b2e931021df1b30310d40433437ca290 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, vendor=Red Hat, Inc., version=8, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, release=754, GIT_CLEAN=True, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True) 2024-05-25T05:35:52.265 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:51 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:35:52.265 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Failed with result 'exit-code'. 2024-05-25T05:35:52.265 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 systemd[1]: Stopped Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:52.265 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service: Consumed 7.945s CPU time. 2024-05-25T05:35:52.266 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 systemd[1]: Starting Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:35:52.608 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 podman[78323]: 2024-05-25 05:35:52.383709991 +0000 UTC m=+0.017081631 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:35:52.608 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 podman[78323]: 2024-05-25 05:35:52.510662622 +0000 UTC m=+0.144034256 container create 92afd76e3ef8c138a5fc90bd5ba3243e62e6f7f9323caeee80ad0052135141b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, ceph=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, RELEASE=squid-ea0684c, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=) 2024-05-25T05:35:52.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:52 smithi136 ceph-mon[25618]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:52.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 podman[78323]: 2024-05-25 05:35:52.738661526 +0000 UTC m=+0.372033158 container init 92afd76e3ef8c138a5fc90bd5ba3243e62e6f7f9323caeee80ad0052135141b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, ceph=True, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c) 2024-05-25T05:35:52.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 podman[78323]: 2024-05-25 05:35:52.742020374 +0000 UTC m=+0.375392007 container start 92afd76e3ef8c138a5fc90bd5ba3243e62e6f7f9323caeee80ad0052135141b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux ) 2024-05-25T05:35:52.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 ceph-mgr[78342]: -- 172.21.15.136:0/2211693767 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557d8e4825a0 con 0x557d8e456800 2024-05-25T05:35:52.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 bash[78323]: 92afd76e3ef8c138a5fc90bd5ba3243e62e6f7f9323caeee80ad0052135141b1 2024-05-25T05:35:52.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 systemd[1]: Started Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:35:53.205 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:52 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:52.902+0000 7fb16b2cb200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:35:53.205 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:53.098+0000 7fb16b2cb200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:53.205 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:53.205+0000 7fb16b2cb200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:35:53.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:52 smithi088 ceph-mon[24736]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:53.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:52 smithi088 ceph-mon[29649]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:53.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:53.538+0000 7fb16b2cb200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:35:53.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:53.630+0000 7fb16b2cb200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:35:54.208 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.208 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.209 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.210 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.213 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.214 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.215 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.216 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.217 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.217 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.217 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.217 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.217 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.217 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:54.332 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr.x"}]': finished 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.333 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.334 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.335 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.336 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:54.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:54.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:54.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:54.337 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:54.533 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:35:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:35:54] "GET /metrics HTTP/1.1" 200 37910 "" "Prometheus/2.33.4" 2024-05-25T05:35:55.033 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:54.970+0000 7fb16b2cb200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:35:55.033 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.033 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.034 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.035 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:55.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:55.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.321 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.321 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.321 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.321 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.321 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.321 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.326 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.326 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.326 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.326 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.330 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.330 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.330 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.330 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.330 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.330 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.331 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.331 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.331 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.331 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.331 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.332 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.332 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.332 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.332 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:55.332 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:55.332 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:55.333 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:55.333 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:55.333 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:55.152+0000 7fb16b2cb200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:55.622 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:55.330+0000 7fb16b2cb200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:35:55.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:55.641+0000 7fb16b2cb200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:35:55.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:55.738+0000 7fb16b2cb200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:35:56.284 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:55.952+0000 7fb16b2cb200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:56.164+0000 7fb16b2cb200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.287 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.288 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.289 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.290 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:56.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:56.829+0000 7fb16b2cb200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:57.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:57.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:57.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:57.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:57.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:57.431 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:57.327+0000 7fb16b2cb200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:35:57.431 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:57.431+0000 7fb16b2cb200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:35:57.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:57.646+0000 7fb16b2cb200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:35:58.212 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.212 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.212 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.212 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.212 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.212 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.212 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.213 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.214 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.215 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:58.505 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:58.211+0000 7fb16b2cb200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:35:58.505 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:58.310+0000 7fb16b2cb200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:35:58.757 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:58.590+0000 7fb16b2cb200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:35:58.757 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:58.732+0000 7fb16b2cb200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:35:59.069 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:58.837+0000 7fb16b2cb200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:35:59.069 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:58.964+0000 7fb16b2cb200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.070 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.071 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.072 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.073 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.074 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.075 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:35:59.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:35:59.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:35:59.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:59.282+0000 7fb16b2cb200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:36:00.266 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:35:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:35:59.914+0000 7fb16b2cb200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:36:00.266 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:36:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:36:00.158+0000 7fb16b2cb200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:36:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: [25/May/2024:05:36:00] ENGINE Bus STARTING 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:36:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: CherryPy Checker: 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:36:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: The Application mounted at '' has an empty config. 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:36:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:36:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: [25/May/2024:05:36:00] ENGINE Serving on http://:::9283 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.267 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.269 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.270 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.271 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:35:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:00.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:00.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:00.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:00.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:35:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:00.534 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:36:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: [25/May/2024:05:36:00] ENGINE Bus STARTED 2024-05-25T05:36:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Standby manager daemon x restarted 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: Standby manager daemon x started 2024-05-25T05:36:01.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.150 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Standby manager daemon x restarted 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: Standby manager daemon x started 2024-05-25T05:36:01.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Standby manager daemon x restarted 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:36:01.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/106730906' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:01.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:01.850 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:36:01.850 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 14s ago 27m - - 2024-05-25T05:36:01.850 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 14s ago 27m - - 2024-05-25T05:36:01.850 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (14m) 14s ago 22m 21.9M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (13m) 14s ago 21m 55.2M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (35s) 14s ago 21m 50.2M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 starting - - - - 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (11m) 14s ago 28m 508M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (28m) 14s ago 28m 87.0M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (27m) 14s ago 27m 61.5M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (27m) 14s ago 27m 62.4M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (14m) 14s ago 22m 17.6M - 1.3.1 1dbe0e931976 a11a34b18e29 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (13m) 14s ago 22m 17.8M - 1.3.1 1dbe0e931976 85883e864814 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (26m) 14s ago 26m 54.6M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (26m) 14s ago 26m 55.9M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (25m) 14s ago 25m 50.4M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:36:01.851 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (25m) 14s ago 25m 56.3M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:36:01.852 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (24m) 14s ago 24m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:36:01.852 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (24m) 14s ago 24m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:36:01.852 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (24m) 14s ago 24m 54.6M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:36:01.852 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (23m) 14s ago 23m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:36:01.852 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (49s) 14s ago 23m 64.4M - 2.33.4 514e6a882f6e a3c4b9bf75f8 2024-05-25T05:36:01.852 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (21m) 14s ago 21m 77.0M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:36:01.852 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (21m) 14s ago 21m 78.3M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: mgrmap e42: y(active, since 62s), standbys: x 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:02.296 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:36:02.297 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.299 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.300 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: mgrmap e42: y(active, since 62s), standbys: x 2024-05-25T05:36:02.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.301 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.301 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.301 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.302 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: mgrmap e42: y(active, since 62s), standbys: x 2024-05-25T05:36:02.303 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.304 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.305 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:02.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:02.650 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "", 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mgr daemons", 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:36:02.651 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:36:03.192 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='client.25459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='client.15573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.193 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.194 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1361450631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.195 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.196 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.197 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='client.25459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='client.15573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Upgrade: 1 mgr daemon(s) are 17.2.0 != target 19.0.0-2843-gea0684c0 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='client.25459 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='client.15573 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='client.15579 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1361450631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1361450631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:03.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:03.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:03.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:03.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:03.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='client.15591 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:04.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.290 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.292 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:04.292 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:04.292 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:04.292 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:04.292 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:04.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:36:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:36:04] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.041 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.044 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.045 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.046 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.047 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.056 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.056 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.056 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.056 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.056 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.056 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:05.056 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.059 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.060 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:05.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.086 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.088 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.089 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.094 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:06.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:06.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:06.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.127 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.128 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.129 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.130 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:07.131 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.132 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.133 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:07.134 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:08.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:08.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all crash 2024-05-25T05:36:08.077 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all mds 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all nfs 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.078 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all crash 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all mds 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all nfs 2024-05-25T05:36:08.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:36:08.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:08.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:08.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all crash 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all mds 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all nfs 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:08.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:09.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:08 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:09.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:08 smithi088 ceph-mon[24736]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:08 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:08 smithi088 ceph-mon[29649]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:09.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:08 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:09.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:08 smithi136 ceph-mon[25618]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:09.806 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:09 smithi088 systemd[1]: Stopping Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:10.164 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:09 smithi088 ceph-mon[24736]: Upgrade: Updating node-exporter.a (1/2) 2024-05-25T05:36:10.165 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:09 smithi088 ceph-mon[24736]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:36:10.165 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:09 smithi088 ceph-mon[29649]: Upgrade: Updating node-exporter.a (1/2) 2024-05-25T05:36:10.165 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:09 smithi088 ceph-mon[29649]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:36:10.165 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:09 smithi088 podman[97347]: 2024-05-25 05:36:09.891337563 +0000 UTC m=+0.144120905 container died a11a34b18e2942fdeded5f95778e77ea087fefa4f699233716a854cf2e404018 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:09 smithi136 ceph-mon[25618]: Upgrade: Updating node-exporter.a (1/2) 2024-05-25T05:36:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:09 smithi136 ceph-mon[25618]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:36:10.514 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 podman[97347]: 2024-05-25 05:36:10.264088241 +0000 UTC m=+0.516871629 container cleanup a11a34b18e2942fdeded5f95778e77ea087fefa4f699233716a854cf2e404018 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:10.514 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 bash[97347]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a 2024-05-25T05:36:10.806 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 podman[97361]: 2024-05-25 05:36:10.515034913 +0000 UTC m=+0.627332327 container remove a11a34b18e2942fdeded5f95778e77ea087fefa4f699233716a854cf2e404018 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:10.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:36:10.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-05-25T05:36:10.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 systemd[1]: Stopped Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:10.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Consumed 5.067s CPU time. 2024-05-25T05:36:11.191 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:10 smithi136 ceph-mon[25618]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:11.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:10 smithi088 ceph-mon[29649]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:10 smithi088 ceph-mon[24736]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:11.307 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:10 smithi088 systemd[1]: Starting Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:11.307 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:11 smithi088 bash[97485]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-05-25T05:36:11.806 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:11 smithi088 bash[97485]: Getting image source signatures 2024-05-25T05:36:11.806 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:11 smithi088 bash[97485]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-05-25T05:36:11.806 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:11 smithi088 bash[97485]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-05-25T05:36:11.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:11 smithi088 bash[97485]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-05-25T05:36:13.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:12 smithi088 ceph-mon[24736]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:13.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:12 smithi088 ceph-mon[29649]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:13.057 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:12 smithi088 bash[97485]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-05-25T05:36:13.057 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:12 smithi088 bash[97485]: Writing manifest to image destination 2024-05-25T05:36:13.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:12 smithi136 ceph-mon[25618]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:13.504 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 podman[97485]: 2024-05-25 05:36:13.137878091 +0000 UTC m=+2.178139362 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-05-25T05:36:13.505 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 podman[97485]: 2024-05-25 05:36:13.244661698 +0000 UTC m=+2.284922957 container create 0886d6b0bc26d670273539471b200ba575518759b56d8b5b5efe2ae20b8e6330 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:13.505 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 podman[97485]: 2024-05-25 05:36:13.505454793 +0000 UTC m=+2.545716065 container init 0886d6b0bc26d670273539471b200ba575518759b56d8b5b5efe2ae20b8e6330 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 podman[97485]: 2024-05-25 05:36:13.508647973 +0000 UTC m=+2.548909235 container start 0886d6b0bc26d670273539471b200ba575518759b56d8b5b5efe2ae20b8e6330 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.512Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.512Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.513Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.513Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.513Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.513Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=arp 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=bcache 2024-05-25T05:36:13.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=bonding 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=btrfs 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=conntrack 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=cpu 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=diskstats 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=dmi 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=edac 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=entropy 2024-05-25T05:36:13.808 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=filefd 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=filesystem 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=hwmon 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=infiniband 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=ipvs 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=loadavg 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=mdadm 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=meminfo 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=netclass 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=netdev 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=netstat 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=nfs 2024-05-25T05:36:13.809 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=nfsd 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=nvme 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=os 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=pressure 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=rapl 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=schedstat 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=selinux 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=sockstat 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=softnet 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=stat 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=tapestats 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=textfile 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-05-25T05:36:13.810 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=time 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=uname 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=vmstat 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=xfs 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=node_exporter.go:117 level=info collector=zfs 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[97535]: ts=2024-05-25T05:36:13.514Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 bash[97485]: 0886d6b0bc26d670273539471b200ba575518759b56d8b5b5efe2ae20b8e6330 2024-05-25T05:36:13.811 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:13 smithi088 systemd[1]: Started Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:14.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:36:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:36:14] "GET /metrics HTTP/1.1" 200 37909 "" "Prometheus/2.33.4" 2024-05-25T05:36:14.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:14 smithi136 ceph-mon[25618]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:14.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:14.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:14.855 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:15.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[24736]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:15.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[29649]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:16.363 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:16 smithi136 systemd[1]: Stopping Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:16.634 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:16 smithi136 podman[83652]: 2024-05-25 05:36:16.36275391 +0000 UTC m=+0.112804773 container died 85883e86481410abc5ee971f84da73a33ec7d7bba34675a75637a43f1eac0c86 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:17.020 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:16 smithi136 ceph-mon[25618]: Upgrade: Updating node-exporter.b (2/2) 2024-05-25T05:36:17.020 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:16 smithi136 ceph-mon[25618]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:36:17.020 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:16 smithi136 ceph-mon[25618]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:17.020 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:16 smithi136 podman[83652]: 2024-05-25 05:36:16.768959338 +0000 UTC m=+0.519010191 container cleanup 85883e86481410abc5ee971f84da73a33ec7d7bba34675a75637a43f1eac0c86 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:17.020 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:16 smithi136 bash[83652]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b 2024-05-25T05:36:17.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:16 smithi088 ceph-mon[24736]: Upgrade: Updating node-exporter.b (2/2) 2024-05-25T05:36:17.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:16 smithi088 ceph-mon[24736]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:36:17.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:16 smithi088 ceph-mon[24736]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:16 smithi088 ceph-mon[29649]: Upgrade: Updating node-exporter.b (2/2) 2024-05-25T05:36:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:16 smithi088 ceph-mon[29649]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:36:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:16 smithi088 ceph-mon[29649]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:17.343 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 podman[83664]: 2024-05-25 05:36:17.020922748 +0000 UTC m=+0.661637797 container remove 85883e86481410abc5ee971f84da73a33ec7d7bba34675a75637a43f1eac0c86 (image=quay.io/prometheus/node-exporter:v1.3.1, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:17.343 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:36:17.343 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-05-25T05:36:17.343 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 systemd[1]: Stopped Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:17.343 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Consumed 5.443s CPU time. 2024-05-25T05:36:17.631 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 systemd[1]: Starting Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:17.884 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 bash[83792]: Trying to pull quay.io/prometheus/node-exporter:v1.5.0... 2024-05-25T05:36:18.384 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 bash[83792]: Getting image source signatures 2024-05-25T05:36:18.384 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 bash[83792]: Copying blob sha256:22b70bddd3acadc892fca4c2af4260629bfda5dfd11ebc106a93ce24e752b5ed 2024-05-25T05:36:18.384 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 bash[83792]: Copying blob sha256:5c12815fee558b157dee7f7509dedbaba0a8379098858a65ec869e1f1526ea0c 2024-05-25T05:36:18.384 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:17 smithi136 bash[83792]: Copying blob sha256:c0e87333d3805a7b7e1c25783dd25f27da0fe70a8e262eee7ed190c8dc843fa7 2024-05-25T05:36:18.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:18 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:18.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:18 smithi088 ceph-mon[24736]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:18.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:18 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:18.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:18 smithi088 ceph-mon[29649]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:19.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:18 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:19.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:18 smithi136 ceph-mon[25618]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:19.634 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:19 smithi136 bash[83792]: Copying config sha256:0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 2024-05-25T05:36:19.634 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:19 smithi136 bash[83792]: Writing manifest to image destination 2024-05-25T05:36:20.093 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:19 smithi136 podman[83792]: 2024-05-25 05:36:19.735241886 +0000 UTC m=+2.197022713 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-05-25T05:36:20.094 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:19 smithi136 podman[83792]: 2024-05-25 05:36:19.841973551 +0000 UTC m=+2.303754379 container create f0a81238f2a8f421d14700780e48846384109654d0aa1bf84f09052884bfa663 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 podman[83792]: 2024-05-25 05:36:20.094596511 +0000 UTC m=+2.556377351 container init f0a81238f2a8f421d14700780e48846384109654d0aa1bf84f09052884bfa663 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 podman[83792]: 2024-05-25 05:36:20.097513962 +0000 UTC m=+2.559294795 container start f0a81238f2a8f421d14700780e48846384109654d0aa1bf84f09052884bfa663 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.101Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.101Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-05-25T05:36:20.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=arp 2024-05-25T05:36:20.386 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=bcache 2024-05-25T05:36:20.386 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=bonding 2024-05-25T05:36:20.386 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=btrfs 2024-05-25T05:36:20.386 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=conntrack 2024-05-25T05:36:20.386 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=cpu 2024-05-25T05:36:20.386 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-05-25T05:36:20.386 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=diskstats 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=dmi 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=edac 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=entropy 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=filefd 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=filesystem 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=hwmon 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=infiniband 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=ipvs 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=loadavg 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=mdadm 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=meminfo 2024-05-25T05:36:20.387 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=netclass 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=netdev 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=netstat 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=nfs 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=nfsd 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=nvme 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=os 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=pressure 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=rapl 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=schedstat 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=selinux 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=sockstat 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=softnet 2024-05-25T05:36:20.388 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=stat 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=tapestats 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=textfile 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=time 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=uname 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=vmstat 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=xfs 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.102Z caller=node_exporter.go:117 level=info collector=zfs 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.103Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[83843]: ts=2024-05-25T05:36:20.103Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 bash[83792]: f0a81238f2a8f421d14700780e48846384109654d0aa1bf84f09052884bfa663 2024-05-25T05:36:20.389 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:20 smithi136 systemd[1]: Started Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:20.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:20.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:20.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:20.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:20.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:20 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.082 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.083 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.084 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:21.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.087 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:21.087 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:21.087 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:21.087 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:21.087 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:20 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.092 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.093 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.094 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.096 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.097 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:21 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.098 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.099 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.100 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.101 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:22.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:22.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:22.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:22.102 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:21 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.084 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.084 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.084 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.084 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.084 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:23.084 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.084 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.085 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.086 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.087 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.088 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.089 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.090 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.092 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:22 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.093 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.094 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.095 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.096 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:23.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:23.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:23.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:23.097 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:22 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:36:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:36:24] "GET /metrics HTTP/1.1" 200 37902 "" "Prometheus/2.33.4" 2024-05-25T05:36:24.979 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.979 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.979 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.980 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.981 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.982 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.983 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.984 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.985 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:24.986 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:24 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:24 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.837 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.838 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.839 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.839 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.839 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.839 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.839 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.840 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.841 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:25.842 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.103 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:26.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:27.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:26 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:26 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.939 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.940 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:27.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:28.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.016 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.017 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.018 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.018 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.018 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.018 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.018 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.018 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.054 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.054 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:29.055 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:29.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:30.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:30.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:30.225 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:31.031 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:30 smithi088 ceph-mon[29649]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:31.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:30 smithi088 ceph-mon[24736]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:31.302 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:30 smithi136 ceph-mon[25618]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:33.038 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:36:33.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:32 smithi136 ceph-mon[25618]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:33.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[29649]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:33.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[24736]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:33.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:33.716 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:36:33.716 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 0s ago 28m - - 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 0s ago 27m - - 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (14m) 0s ago 22m 21.9M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (14m) 0s ago 22m 54.9M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (67s) 0s ago 21m 50.6M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (41s) 0s ago 27m 451M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (11m) 0s ago 28m 511M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (28m) 0s ago 29m 90.8M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (27m) 0s ago 27m 66.3M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (27m) 0s ago 27m 66.1M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (20s) 0s ago 23m 8036k - 1.5.0 0da6a335fe13 0886d6b0bc26 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (13s) 0s ago 23m 3657k - 1.5.0 0da6a335fe13 f0a81238f2a8 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (26m) 0s ago 26m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:36:33.717 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (26m) 0s ago 26m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (26m) 0s ago 26m 50.5M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (25m) 0s ago 25m 56.3M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (25m) 0s ago 25m 56.9M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (25m) 0s ago 25m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (24m) 0s ago 24m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (24m) 0s ago 24m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (81s) 0s ago 23m 64.8M - 2.33.4 514e6a882f6e a3c4b9bf75f8 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (21m) 0s ago 21m 77.1M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:36:33.718 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (21m) 0s ago 21m 78.5M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: Upgrade: Updating node-exporter.a (1/2) 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: from='client.15597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: Upgrade: Updating node-exporter.a (1/2) 2024-05-25T05:36:34.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:36:34.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: from='client.15597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:34.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:34.188 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:36:34.189 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:36:34.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: Upgrade: Updating node-exporter.a (1/2) 2024-05-25T05:36:34.216 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: Deploying daemon node-exporter.a on smithi088 2024-05-25T05:36:34.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: from='client.15597 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:34.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.217 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:34.322 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:36:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:36:34] "GET /metrics HTTP/1.1" 200 37910 "" "Prometheus/2.33.4" 2024-05-25T05:36:34.322 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:34 smithi088 systemd[1]: Stopping Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:34.539 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:36:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:36:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:36:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:36:34.539 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-05-25T05:36:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-05-25T05:36:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:36:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-05-25T05:36:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading node-exporter daemons", 2024-05-25T05:36:34.540 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:36:34.540 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:36:34.672 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:34 smithi088 podman[100629]: 2024-05-25 05:36:34.370036045 +0000 UTC m=+0.141218271 container died 0886d6b0bc26d670273539471b200ba575518759b56d8b5b5efe2ae20b8e6330 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:34.932 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:34 smithi088 podman[100629]: 2024-05-25 05:36:34.7705916 +0000 UTC m=+0.541773808 container cleanup 0886d6b0bc26d670273539471b200ba575518759b56d8b5b5efe2ae20b8e6330 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:34.932 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:34 smithi088 bash[100629]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a 2024-05-25T05:36:35.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:35.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: from='client.15609 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2552498818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: from='client.15609 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2552498818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.231 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: from='client.15603 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:35.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:36:35.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: from='client.15609 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:35.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2552498818' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:35.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:35.232 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:34 smithi088 podman[100677]: 2024-05-25 05:36:34.996971054 +0000 UTC m=+0.630678189 container remove 0886d6b0bc26d670273539471b200ba575518759b56d8b5b5efe2ae20b8e6330 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:35.232 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:34 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:36:35.232 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-05-25T05:36:35.232 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 systemd[1]: Stopped Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:35.233 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Consumed 1.749s CPU time. 2024-05-25T05:36:35.543 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 systemd[1]: Starting Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:35.806 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 podman[100806]: 2024-05-25 05:36:35.44593241 +0000 UTC m=+0.017182577 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-05-25T05:36:35.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 podman[100806]: 2024-05-25 05:36:35.572999288 +0000 UTC m=+0.144249463 container create b882d57e2d6ee2ba4e1b7fb0b7c5ed09b4d9d7be43ee72bb1ec758bea2adf5a3 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:35 smithi088 ceph-mon[29649]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:35 smithi088 ceph-mon[29649]: from='client.25513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:36.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:35 smithi088 ceph-mon[29649]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:36:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-mon[24736]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-mon[24736]: from='client.25513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-mon[24736]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 podman[100806]: 2024-05-25 05:36:35.825552441 +0000 UTC m=+0.396802606 container init b882d57e2d6ee2ba4e1b7fb0b7c5ed09b4d9d7be43ee72bb1ec758bea2adf5a3 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 podman[100806]: 2024-05-25 05:36:35.828488371 +0000 UTC m=+0.399738533 container start b882d57e2d6ee2ba4e1b7fb0b7c5ed09b4d9d7be43ee72bb1ec758bea2adf5a3 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.832Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.832Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.832Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.832Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=arp 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=bcache 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=bonding 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=btrfs 2024-05-25T05:36:36.308 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=conntrack 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=cpu 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=diskstats 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=dmi 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=edac 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=entropy 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=filefd 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=filesystem 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=hwmon 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=infiniband 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=ipvs 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=loadavg 2024-05-25T05:36:36.309 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=mdadm 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=meminfo 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=netclass 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=netdev 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=netstat 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=nfs 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=nfsd 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=nvme 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=os 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=pressure 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=rapl 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=schedstat 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=selinux 2024-05-25T05:36:36.310 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=sockstat 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=softnet 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=stat 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=tapestats 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=textfile 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=time 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=uname 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=vmstat 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=xfs 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=node_exporter.go:117 level=info collector=zfs 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a[100821]: ts=2024-05-25T05:36:35.833Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-05-25T05:36:36.311 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 bash[100806]: b882d57e2d6ee2ba4e1b7fb0b7c5ed09b4d9d7be43ee72bb1ec758bea2adf5a3 2024-05-25T05:36:36.312 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:36:35 smithi088 systemd[1]: Started Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:35 smithi136 ceph-mon[25618]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:35 smithi136 ceph-mon[25618]: from='client.25513 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:36:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:35 smithi136 ceph-mon[25618]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:36:37.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:37.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:37.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:37.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:37.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:38.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:37 smithi136 ceph-mon[25618]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:37 smithi088 ceph-mon[24736]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:37 smithi088 ceph-mon[29649]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:38.833 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:38 smithi136 systemd[1]: Stopping Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:39.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:39 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:39.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:39 smithi136 ceph-mon[25618]: Upgrade: Updating node-exporter.b (2/2) 2024-05-25T05:36:39.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:39 smithi136 ceph-mon[25618]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:36:39.135 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:38 smithi136 podman[86953]: 2024-05-25 05:36:38.833749765 +0000 UTC m=+0.113785893 container died f0a81238f2a8f421d14700780e48846384109654d0aa1bf84f09052884bfa663 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:39 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:39 smithi088 ceph-mon[24736]: Upgrade: Updating node-exporter.b (2/2) 2024-05-25T05:36:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:39 smithi088 ceph-mon[24736]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:36:39.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:39 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:39.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:39 smithi088 ceph-mon[29649]: Upgrade: Updating node-exporter.b (2/2) 2024-05-25T05:36:39.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:39 smithi088 ceph-mon[29649]: Deploying daemon node-exporter.b on smithi136 2024-05-25T05:36:39.565 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 podman[86953]: 2024-05-25 05:36:39.307088426 +0000 UTC m=+0.587124545 container cleanup f0a81238f2a8f421d14700780e48846384109654d0aa1bf84f09052884bfa663 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:39.566 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 bash[86953]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b 2024-05-25T05:36:39.833 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 podman[86967]: 2024-05-25 05:36:39.566587922 +0000 UTC m=+0.733300077 container remove f0a81238f2a8f421d14700780e48846384109654d0aa1bf84f09052884bfa663 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:39.834 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:36:39.834 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-05-25T05:36:39.834 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 systemd[1]: Stopped Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:39.834 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Consumed 1.725s CPU time. 2024-05-25T05:36:40.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-mon[25618]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:40.135 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:39 smithi136 systemd[1]: Starting Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:36:40.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:40 smithi088 ceph-mon[24736]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:40.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:40 smithi088 ceph-mon[29649]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:40.478 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 podman[87090]: 2024-05-25 05:36:40.056817658 +0000 UTC m=+0.017032661 image pull 0da6a335fe1356545476b749c68f022c897de3a2139e8f0054f6937349ee2b83 quay.io/prometheus/node-exporter:v1.5.0 2024-05-25T05:36:40.478 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 podman[87090]: 2024-05-25 05:36:40.159472554 +0000 UTC m=+0.119687546 container create c86191bd770a3ec7c3be48219ea1834879e3af6240dc3d0c68797c591d68f043 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:40.478 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 podman[87090]: 2024-05-25 05:36:40.395233582 +0000 UTC m=+0.355448593 container init c86191bd770a3ec7c3be48219ea1834879e3af6240dc3d0c68797c591d68f043 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:40.478 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 podman[87090]: 2024-05-25 05:36:40.397989965 +0000 UTC m=+0.358204958 container start c86191bd770a3ec7c3be48219ea1834879e3af6240dc3d0c68797c591d68f043 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:36:40.478 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.401Z caller=node_exporter.go:180 level=info msg="Starting node_exporter" version="(version=1.5.0, branch=HEAD, revision=1b48970ffcf5630534fb00bb0687d73c66d1c959)" 2024-05-25T05:36:40.478 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.401Z caller=node_exporter.go:181 level=info msg="Build context" build_context="(go=go1.19.3, user=root@6e7732a7b81b, date=20221129-18:59:09)" 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.401Z caller=diskstats_common.go:111 level=info collector=diskstats msg="Parsed flag --collector.diskstats.device-exclude" flag=^(ram|loop|fd|(h|s|v|xv)d[a-z]|nvme\d+n\d+p)\d+$ 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=diskstats_linux.go:264 level=error collector=diskstats msg="Failed to open directory, disabling udev device properties" path=/run/udev/data 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=filesystem_common.go:111 level=info collector=filesystem msg="Parsed flag --collector.filesystem.mount-points-exclude" flag=^/(dev|proc|run/credentials/.+|sys|var/lib/docker/.+|var/lib/containers/storage/.+)($|/) 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=filesystem_common.go:113 level=info collector=filesystem msg="Parsed flag --collector.filesystem.fs-types-exclude" flag=^(autofs|binfmt_misc|bpf|cgroup2?|configfs|debugfs|devpts|devtmpfs|fusectl|hugetlbfs|iso9660|mqueue|nsfs|overlay|proc|procfs|pstore|rpc_pipefs|securityfs|selinuxfs|squashfs|sysfs|tracefs)$ 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:110 level=info msg="Enabled collectors" 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=arp 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=bcache 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=bonding 2024-05-25T05:36:40.479 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=btrfs 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=conntrack 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=cpu 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=cpufreq 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=diskstats 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=dmi 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=edac 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=entropy 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=fibrechannel 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=filefd 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=filesystem 2024-05-25T05:36:40.480 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=hwmon 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=infiniband 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=ipvs 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=loadavg 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=mdadm 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=meminfo 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=netclass 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=netdev 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=netstat 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=nfs 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=nfsd 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=nvme 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=os 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=powersupplyclass 2024-05-25T05:36:40.481 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=pressure 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=rapl 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=schedstat 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=selinux 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=sockstat 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=softnet 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=stat 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=tapestats 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=textfile 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=thermal_zone 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=time 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=udp_queues 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=uname 2024-05-25T05:36:40.482 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=vmstat 2024-05-25T05:36:40.483 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=xfs 2024-05-25T05:36:40.483 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.402Z caller=node_exporter.go:117 level=info collector=zfs 2024-05-25T05:36:40.483 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.403Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9100 2024-05-25T05:36:40.483 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b[87105]: ts=2024-05-25T05:36:40.403Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9100 2024-05-25T05:36:40.483 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 bash[87090]: c86191bd770a3ec7c3be48219ea1834879e3af6240dc3d0c68797c591d68f043 2024-05-25T05:36:40.884 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:36:40 smithi136 systemd[1]: Started Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:36:41.697 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.698 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.699 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:36:41.700 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.701 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: Cluster is now healthy 2024-05-25T05:36:41.702 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: Cluster is now healthy 2024-05-25T05:36:41.704 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 946 B/s rd, 0 op/s 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:41.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: Cluster is now healthy 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:41.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:41.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.843 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:42.844 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.781 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.781 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.781 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.781 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.781 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.782 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.785 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.1 KiB/s rd, 1 op/s 2024-05-25T05:36:43.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:43.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.540 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:36:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:36:44] "GET /metrics HTTP/1.1" 200 37910 "" "Prometheus/2.33.4" 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.722 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.723 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.724 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.725 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.725 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.725 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.725 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.725 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.725 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:44.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:45.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.783 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.783 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.783 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.783 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.784 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.785 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:46 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:46.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:46 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:47.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.591 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.592 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.593 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.594 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.595 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:48 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.719 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.719 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:48.719 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.719 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.719 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.719 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.719 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.720 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.721 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.723 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.724 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.725 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.726 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:48.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:48.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:48.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:48.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:48.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.878 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.879 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.880 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.882 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:49 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.956 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 997 B/s rd, 0 op/s 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.958 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.959 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.961 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:49.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.729 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.732 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:50.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:50 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:51 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.930 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.930 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.930 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.5 KiB/s rd, 1 op/s 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:51.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.935 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.936 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.937 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:51.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:51.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:51.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:51.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:51.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.667 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.668 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:52.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:52.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:52.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:52.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:52 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.528 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:36:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:36:54] "GET /metrics HTTP/1.1" 200 37903 "" "Prometheus/2.33.4" 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.856 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:36:54.857 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.858 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:36:54.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:54.859 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:55 smithi136 ceph-mon[25618]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:36:55.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.744 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[24736]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[29649]: pgmap v62: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:55.911 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:36:57.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:57 smithi136 ceph-mon[25618]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:58.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:57 smithi088 ceph-mon[24736]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:58.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:57 smithi088 ceph-mon[29649]: pgmap v63: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:36:58.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:58 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:58.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:58 smithi088 ceph-mon[29649]: Upgrade: Updating prometheus.a 2024-05-25T05:36:58.742 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:58 smithi088 ceph-mon[29649]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:36:58.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:58 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:58.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:58 smithi088 ceph-mon[24736]: Upgrade: Updating prometheus.a 2024-05-25T05:36:58.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:58 smithi088 ceph-mon[24736]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:36:58.828 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:58 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:36:58.828 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:58 smithi136 ceph-mon[25618]: Upgrade: Updating prometheus.a 2024-05-25T05:36:58.828 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:58 smithi136 ceph-mon[25618]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:37:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:59 smithi136 ceph-mon[25618]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:36:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:00.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:59 smithi088 ceph-mon[24736]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:00.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:36:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:59 smithi088 ceph-mon[29649]: pgmap v64: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:00.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:36:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:01 smithi136 ceph-mon[25618]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:02.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:01 smithi088 ceph-mon[24736]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:02.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:01 smithi088 ceph-mon[29649]: pgmap v65: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:04.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:03 smithi136 ceph-mon[25618]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:04.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:03 smithi088 ceph-mon[29649]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:03 smithi088 ceph-mon[24736]: pgmap v66: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:04.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:37:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:37:04] "GET /metrics HTTP/1.1" 200 37908 "" "Prometheus/2.33.4" 2024-05-25T05:37:04.907 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:37:05.558 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 10s ago 28m - - 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 10s ago 28m - - 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (15m) 10s ago 23m 22.4M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (14m) 10s ago 22m 55.5M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (98s) 10s ago 22m 50.8M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (73s) 10s ago 27m 452M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (12m) 10s ago 29m 517M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (29m) 10s ago 29m 93.5M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (28m) 10s ago 28m 70.2M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (28m) 10s ago 28m 67.7M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (30s) 10s ago 23m 8090k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (25s) 10s ago 23m 6983k - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (27m) 10s ago 27m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:37:05.559 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (27m) 10s ago 27m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (26m) 10s ago 26m 50.5M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (26m) 10s ago 26m 56.3M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (25m) 10s ago 25m 56.9M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (25m) 10s ago 25m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (25m) 10s ago 25m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (24m) 10s ago 24m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (113s) 10s ago 24m 65.1M - 2.33.4 514e6a882f6e a3c4b9bf75f8 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (22m) 10s ago 22m 77.2M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:37:05.560 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (22m) 10s ago 22m 78.6M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:37:05.952 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:37:05.953 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:37:05.954 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:05.954 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:37:05.954 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:37:05.954 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:37:05.954 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:37:05.954 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:37:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:05 smithi136 ceph-mon[25618]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:06.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:05 smithi136 ceph-mon[25618]: from='client.15627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading prometheus daemons", 2024-05-25T05:37:06.285 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:37:06.286 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:37:06.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:05 smithi088 ceph-mon[24736]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:06.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:05 smithi088 ceph-mon[24736]: from='client.15627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:06.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:05 smithi088 ceph-mon[29649]: pgmap v67: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:06.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:05 smithi088 ceph-mon[29649]: from='client.15627 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:07.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:06 smithi136 ceph-mon[25618]: from='client.25525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:07.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:06 smithi136 ceph-mon[25618]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:07.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:06 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/12788792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:07.182 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:06 smithi088 ceph-mon[24736]: from='client.25525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:07.182 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:06 smithi088 ceph-mon[24736]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:07.182 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:06 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/12788792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:07.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:06 smithi088 ceph-mon[29649]: from='client.25525 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:07.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:06 smithi088 ceph-mon[29649]: from='client.15639 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:07.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:06 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/12788792' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:08.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:07 smithi136 ceph-mon[25618]: from='client.15651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:08.203 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:07 smithi136 ceph-mon[25618]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:08.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:07 smithi088 ceph-mon[29649]: from='client.15651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:08.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:07 smithi088 ceph-mon[29649]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:08.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:07 smithi088 ceph-mon[24736]: from='client.15651 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:08.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:07 smithi088 ceph-mon[24736]: pgmap v68: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:08.996 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:08 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:09.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:08 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:09.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:08 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:09 smithi136 ceph-mon[25618]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:10.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:09 smithi088 ceph-mon[24736]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:10.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:09 smithi088 ceph-mon[29649]: pgmap v69: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:10.549 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:37:10.857 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.548Z caller=main.go:775 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:37:10.857 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:798 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:37:10.857 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:812 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:37:10.857 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:834 level=info msg="Stopping scrape manager..." 2024-05-25T05:37:10.857 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:808 level=info msg="Notify discovery manager stopped" 2024-05-25T05:37:10.857 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:794 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:37:10.857 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=manager.go:945 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:37:10.858 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:828 level=info msg="Scrape manager stopped" 2024-05-25T05:37:10.858 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=manager.go:955 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:37:10.858 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=notifier.go:600 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:37:10.858 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:1054 level=info msg="Notifier manager stopped" 2024-05-25T05:37:10.858 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[71261]: ts=2024-05-25T05:37:10.549Z caller=main.go:1066 level=info msg="See you next time!" 2024-05-25T05:37:10.858 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 podman[92030]: 2024-05-25 05:37:10.559010321 +0000 UTC m=+0.123866871 container died a3c4b9bf75f8f0435a8329e35a602c5f1f619256032e73fa56063129cb0e1cfb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:11.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 podman[92030]: 2024-05-25 05:37:10.965313012 +0000 UTC m=+0.530169556 container cleanup a3c4b9bf75f8f0435a8329e35a602c5f1f619256032e73fa56063129cb0e1cfb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:11.134 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:10 smithi136 bash[92030]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:37:11.488 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:11 smithi136 podman[92044]: 2024-05-25 05:37:11.183395926 +0000 UTC m=+0.626075455 container remove a3c4b9bf75f8f0435a8329e35a602c5f1f619256032e73fa56063129cb0e1cfb (image=quay.io/prometheus/prometheus:v2.33.4, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:11.489 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:11 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-25T05:37:11.489 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:11 smithi136 systemd[1]: Stopped Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:37:11.489 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:11 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Consumed 1.629s CPU time. 2024-05-25T05:37:11.772 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:11 smithi136 systemd[1]: Starting Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:37:12.087 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:11 smithi136 ceph-mon[25618]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:12.087 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:11 smithi136 podman[92220]: 2024-05-25 05:37:11.71366901 +0000 UTC m=+0.020007872 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-05-25T05:37:12.087 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:11 smithi136 podman[92220]: 2024-05-25 05:37:11.851956256 +0000 UTC m=+0.158295161 container create 663b599c432d144428ff7d26f9041b51fe772c6929d85d67556512204f830896 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:12.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:11 smithi088 ceph-mon[24736]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:11 smithi088 ceph-mon[29649]: pgmap v70: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 podman[92220]: 2024-05-25 05:37:12.087728695 +0000 UTC m=+0.394067553 container init 663b599c432d144428ff7d26f9041b51fe772c6929d85d67556512204f830896 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 podman[92220]: 2024-05-25 05:37:12.090624688 +0000 UTC m=+0.396963551 container start 663b599c432d144428ff7d26f9041b51fe772c6929d85d67556512204f830896 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.114Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-05-25T05:37:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.114Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-05-25T05:37:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.114Z caller=main.go:570 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:37:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.114Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:37:12.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.114Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.116Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.116Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.118Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.118Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.120Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.120Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.812µs 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.120Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.120Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=6 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.137Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=6 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.147Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=6 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.151Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=6 2024-05-25T05:37:12.386 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.153Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=6 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.155Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=6 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.156Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=6 maxSegment=6 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.156Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=27.159µs wal_replay_duration=35.865187ms wbl_replay_duration=149ns total_replay_duration=35.910252ms 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.161Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.161Z caller=main.go:1029 level=info msg="TSDB started" 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.161Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.178Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=17.399123ms db_storage=826ns remote_storage=870ns web_handler=419ns query_engine=1.089µs scrape=458.174µs scrape_sd=100.589µs notify=9.89µs notify_sd=10.358µs rules=16.52151ms tracing=5.329µs 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.178Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:12.178Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 bash[92220]: 663b599c432d144428ff7d26f9041b51fe772c6929d85d67556512204f830896 2024-05-25T05:37:12.387 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:12 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:13.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.390 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: pgmap v71: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:13.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:13.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:13.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:13.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:13.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:14.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: pgmap v72: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:15.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:15.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:17.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:17 smithi088 ceph-mon[29649]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:17.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:17 smithi088 ceph-mon[24736]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:17.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:17 smithi136 ceph-mon[25618]: pgmap v73: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:18.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:18 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:18.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:18 smithi088 ceph-mon[29649]: Upgrade: Updating prometheus.a 2024-05-25T05:37:18.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:18 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:18.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:18 smithi088 ceph-mon[24736]: Upgrade: Updating prometheus.a 2024-05-25T05:37:18.811 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:18 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:18.811 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:18 smithi136 ceph-mon[25618]: Upgrade: Updating prometheus.a 2024-05-25T05:37:19.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:19 smithi136 ceph-mon[25618]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:37:19.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:19 smithi136 ceph-mon[25618]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:20.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:19 smithi088 ceph-mon[29649]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:37:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:19 smithi088 ceph-mon[29649]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:19 smithi088 ceph-mon[24736]: Deploying daemon prometheus.a on smithi136 2024-05-25T05:37:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:19 smithi088 ceph-mon[24736]: pgmap v74: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:21 smithi136 ceph-mon[25618]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:22.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:21 smithi088 ceph-mon[29649]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:21 smithi088 ceph-mon[24736]: pgmap v75: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:24.109 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[29649]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:24.109 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.109 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.109 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.110 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[24736]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:24.110 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.110 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.110 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:23 smithi136 ceph-mon[25618]: pgmap v76: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:37:24.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:24.541 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:24 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:37:24.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:37:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:37:24] "GET /metrics HTTP/1.1" 200 37919 "" "Prometheus/2.43.0" 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[24736]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[29649]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-05-25T05:37:25.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:25 smithi136 ceph-mon[25618]: pgmap v77: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 857 B/s rd, 0 op/s 2024-05-25T05:37:25.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-05-25T05:37:25.885 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.507Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-05-25T05:37:25.886 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.508Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:37:25.886 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.508Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-05-25T05:37:25.886 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[92269]: ts=2024-05-25T05:37:25.508Z caller=main.go:1147 level=info msg="See you next time!" 2024-05-25T05:37:25.886 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:25 smithi136 podman[94089]: 2024-05-25 05:37:25.517386345 +0000 UTC m=+1.102600723 container died 663b599c432d144428ff7d26f9041b51fe772c6929d85d67556512204f830896 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:26.357 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 podman[94089]: 2024-05-25 05:37:26.139501891 +0000 UTC m=+1.724716269 container cleanup 663b599c432d144428ff7d26f9041b51fe772c6929d85d67556512204f830896 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:26.357 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 bash[94089]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:37:26.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:26 smithi136 ceph-mon[25618]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:37:26.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 podman[94128]: 2024-05-25 05:37:26.357535392 +0000 UTC m=+0.839454586 container remove 663b599c432d144428ff7d26f9041b51fe772c6929d85d67556512204f830896 (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:26.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Deactivated successfully. 2024-05-25T05:37:26.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 systemd[1]: Stopped Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:37:26.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service: Consumed 1.148s CPU time. 2024-05-25T05:37:26.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:26 smithi088 ceph-mon[24736]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:37:26.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:26 smithi088 ceph-mon[29649]: Health check failed: 1 failed cephadm daemon(s) (CEPHADM_FAILED_DAEMON) 2024-05-25T05:37:26.987 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 systemd[1]: Starting Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:37:27.277 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:26 smithi136 podman[94260]: 2024-05-25 05:37:26.891138407 +0000 UTC m=+0.018284632 image pull a07b618ecd1dce142bce4c52f0e80982eaf1f14265a2415c2d35978ccaa0a464 quay.io/prometheus/prometheus:v2.43.0 2024-05-25T05:37:27.277 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 podman[94260]: 2024-05-25 05:37:27.038244066 +0000 UTC m=+0.165390337 container create aea77ce696fab11623cd29bce809a4a532adca5f30046730bdff186a1ab63a7f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:27.277 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 podman[94260]: 2024-05-25 05:37:27.277893471 +0000 UTC m=+0.405039690 container init aea77ce696fab11623cd29bce809a4a532adca5f30046730bdff186a1ab63a7f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:27.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 podman[94260]: 2024-05-25 05:37:27.280623167 +0000 UTC m=+0.407769392 container start aea77ce696fab11623cd29bce809a4a532adca5f30046730bdff186a1ab63a7f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:27.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.303Z caller=main.go:564 level=info msg="Starting Prometheus Server" mode=server version="(version=2.43.0, branch=HEAD, revision=edfc3bcd025dd6fe296c167a14a216cab1e552ee)" 2024-05-25T05:37:27.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.303Z caller=main.go:569 level=info build_context="(go=go1.19.7, platform=linux/amd64, user=root@8a0ee342e522, date=20230321-12:56:07, tags=netgo,builtinassets)" 2024-05-25T05:37:27.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.303Z caller=main.go:570 level=info host_details="(Linux 5.14.0-447.el9.x86_64 #1 SMP PREEMPT_DYNAMIC Tue May 7 10:46:15 UTC 2024 x86_64 smithi136 (none))" 2024-05-25T05:37:27.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.303Z caller=main.go:571 level=info fd_limits="(soft=1048576, hard=1048576)" 2024-05-25T05:37:27.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.303Z caller=main.go:572 level=info vm_limits="(soft=unlimited, hard=unlimited)" 2024-05-25T05:37:27.537 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.305Z caller=web.go:561 level=info component=web msg="Start listening for connections" address=:9095 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.305Z caller=main.go:1005 level=info msg="Starting TSDB ..." 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.306Z caller=tls_config.go:232 level=info component=web msg="Listening on" address=[::]:9095 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.306Z caller=tls_config.go:235 level=info component=web msg="TLS is disabled." http2=false address=[::]:9095 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.307Z caller=head.go:587 level=info component=tsdb msg="Replaying on-disk memory mappable chunks if any" 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.308Z caller=head.go:658 level=info component=tsdb msg="On-disk memory mappable chunks replay completed" duration=1.577µs 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.308Z caller=head.go:664 level=info component=tsdb msg="Replaying WAL, this may take a while" 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.308Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=0 maxSegment=7 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.329Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=1 maxSegment=7 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.337Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=2 maxSegment=7 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.344Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=3 maxSegment=7 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.346Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=4 maxSegment=7 2024-05-25T05:37:27.538 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.348Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=5 maxSegment=7 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.348Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=6 maxSegment=7 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.349Z caller=head.go:735 level=info component=tsdb msg="WAL segment loaded" segment=7 maxSegment=7 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.349Z caller=head.go:772 level=info component=tsdb msg="WAL replay completed" checkpoint_replay_duration=22.505µs wal_replay_duration=41.073572ms wbl_replay_duration=141ns total_replay_duration=41.11292ms 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.352Z caller=main.go:1026 level=info fs_type=XFS_SUPER_MAGIC 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.352Z caller=main.go:1029 level=info msg="TSDB started" 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.352Z caller=main.go:1209 level=info msg="Loading configuration file" filename=/etc/prometheus/prometheus.yml 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.371Z caller=main.go:1246 level=info msg="Completed loading of configuration file" filename=/etc/prometheus/prometheus.yml totalDuration=19.020741ms db_storage=781ns remote_storage=1.022µs web_handler=430ns query_engine=686ns scrape=426.231µs scrape_sd=97.608µs notify=9.217µs notify_sd=10.63µs rules=18.151166ms tracing=5.387µs 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.371Z caller=main.go:990 level=info msg="Server is ready to receive web requests." 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:37:27.371Z caller=manager.go:974 level=info component="rule manager" msg="Starting rule manager..." 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 bash[94260]: aea77ce696fab11623cd29bce809a4a532adca5f30046730bdff186a1ab63a7f 2024-05-25T05:37:27.539 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:37:27 smithi136 systemd[1]: Started Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:27 smithi136 ceph-mon[25618]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-25T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:27.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:27 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[24736]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-25T05:37:27.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[29649]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.3 KiB/s rd, 1 op/s 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:27.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:27 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:28.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:28.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:37:28.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: Cluster is now healthy 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:28 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: Cluster is now healthy 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: Health check cleared: CEPHADM_FAILED_DAEMON (was: 1 failed cephadm daemon(s)) 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: Cluster is now healthy 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-prometheus-api-host"}]: dispatch 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:28.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:28.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:28.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:28.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:28.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:28 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.573 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.574 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.575 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.576 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:29.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:30.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.545 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.546 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.547 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.550 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:31.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:31.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:31.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:31.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:31.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:32.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:32.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.832 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.833 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.834 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.835 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.836 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:33.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:33.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:33.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:33.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:33.837 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.550 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:37:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:37:34] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.43.0" 2024-05-25T05:37:34.707 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.707 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.707 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.707 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.707 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:34.707 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.708 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.709 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.710 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.711 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.711 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.711 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.711 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.711 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.711 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 939 B/s rd, 0 op/s 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:34.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:34.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:34.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:34.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:34.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:34.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:35.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.670 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:37:36.756 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.756 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.756 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.756 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: pgmap v83: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:36.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:36.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.393 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:37:37.393 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 2s ago 29m - - 2024-05-25T05:37:37.393 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 12s ago 28m - - 2024-05-25T05:37:37.393 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (15m) 2s ago 23m 22.4M - 0.23.0 ba2b418f427c 8fd652671476 2024-05-25T05:37:37.393 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (15m) 12s ago 23m 55.1M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:37:37.393 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (2m) 2s ago 22m 51.0M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (104s) 12s ago 28m 452M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (12m) 2s ago 29m 521M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (29m) 2s ago 30m 94.2M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (28m) 12s ago 28m 69.5M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (28m) 2s ago 28m 68.2M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (61s) 2s ago 24m 8472k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (57s) 12s ago 24m 12.6M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (28m) 2s ago 28m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (27m) 2s ago 27m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (27m) 2s ago 27m 50.5M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (26m) 2s ago 26m 56.3M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (26m) 12s ago 26m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (26m) 12s ago 26m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:37:37.394 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (25m) 12s ago 25m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:37:37.395 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (25m) 12s ago 25m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:37:37.395 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 starting - - - - 2024-05-25T05:37:37.395 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (22m) 2s ago 22m 77.3M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:37:37.395 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (22m) 12s ago 22m 78.7M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='client.15657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='client.15657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='client.15657 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='client.15663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:37.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:37:37.835 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:37:37.836 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:37:38.217 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:37:38.217 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:37:38.217 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading prometheus daemons", 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:37:38.218 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:37:38.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.951 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:38.951 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='client.15669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.952 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1192487503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.953 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:38.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='client.15669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:38.954 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1192487503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.955 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.956 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='client.15669 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: pgmap v84: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 933 B/s rd, 0 op/s 2024-05-25T05:37:38.958 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1192487503' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.959 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.960 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.961 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.962 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:38.963 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:38.964 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:38.964 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='client.15681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:39.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.849 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.850 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.852 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:39.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:39.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:39.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:39.853 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='client.15681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='client.15681 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.581 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.582 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.583 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.584 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.585 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.586 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.587 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.588 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.589 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.590 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.591 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.592 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.593 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.594 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.594 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.594 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.594 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: pgmap v85: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:40.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:40.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:40.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:40.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:40.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.923 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.925 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.926 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.927 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.928 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.929 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:41.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:42.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:42.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:42 smithi136 ceph-mon[25618]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:42.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:42.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:42.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:43.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[29649]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[24736]: pgmap v86: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:43.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:44.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:43 smithi088 ceph-mon[24736]: Upgrade: Updating alertmanager.a 2024-05-25T05:37:44.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:43 smithi088 ceph-mon[24736]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:37:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:43 smithi088 ceph-mon[29649]: Upgrade: Updating alertmanager.a 2024-05-25T05:37:44.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:43 smithi088 ceph-mon[29649]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:37:44.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:43 smithi136 ceph-mon[25618]: Upgrade: Updating alertmanager.a 2024-05-25T05:37:44.061 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:43 smithi136 ceph-mon[25618]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:37:44.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:37:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:37:44] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.43.0" 2024-05-25T05:37:44.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:44 smithi136 ceph-mon[25618]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:44.957 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:45.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:44 smithi088 ceph-mon[29649]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:45.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:44 smithi088 ceph-mon[24736]: pgmap v87: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:37:47.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:46 smithi136 ceph-mon[25618]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:47.211 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:46 smithi088 ceph-mon[29649]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:47.211 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:46 smithi088 ceph-mon[24736]: pgmap v88: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:48.938 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:48 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:48.938 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:48 smithi088 ceph-mon[24736]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:48.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:48 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:48.938 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:48 smithi088 ceph-mon[29649]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:49.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:48 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:49.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:48 smithi136 ceph-mon[25618]: pgmap v89: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:51.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:50 smithi136 ceph-mon[25618]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:51.139 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:50 smithi088 ceph-mon[29649]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:51.139 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:50 smithi088 ceph-mon[24736]: pgmap v90: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:51.769 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:51 smithi088 systemd[1]: Stopping Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:37:52.056 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:51 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[64999]: level=info ts=2024-05-25T05:37:51.770Z caller=main.go:557 msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:37:52.056 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:51 smithi088 podman[110744]: 2024-05-25 05:37:51.811057489 +0000 UTC m=+0.148094093 container died 8fd652671476c11de885bb5ff3f4519154085e0398da71187cecd3fcc1855e8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:52.498 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 podman[110744]: 2024-05-25 05:37:52.211506363 +0000 UTC m=+0.548542963 container cleanup 8fd652671476c11de885bb5ff3f4519154085e0398da71187cecd3fcc1855e8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:52.498 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 bash[110744]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a 2024-05-25T05:37:52.778 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 podman[110758]: 2024-05-25 05:37:52.498625219 +0000 UTC m=+0.682913057 container remove 8fd652671476c11de885bb5ff3f4519154085e0398da71187cecd3fcc1855e8a (image=quay.io/prometheus/alertmanager:v0.23.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:52.778 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 podman[110758]: 2024-05-25 05:37:52.580421695 +0000 UTC m=+0.764709540 volume remove 171fe930a3a78f47eb56f220b4b4c0fcc0e0d46908c5cb9522c0879fa6b84278 2024-05-25T05:37:53.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:52 smithi088 ceph-mon[29649]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:53.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:52 smithi088 ceph-mon[24736]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:53.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-25T05:37:53.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 systemd[1]: Stopped Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:37:53.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Consumed 1.532s CPU time. 2024-05-25T05:37:53.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:52 smithi088 systemd[1]: Starting Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:37:53.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:52 smithi136 ceph-mon[25618]: pgmap v91: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:53.470 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 podman[110884]: 2024-05-25 05:37:53.206243317 +0000 UTC m=+0.113472035 volume create c22bac9393fc8a8b319835fda2941a299e1090790b9de6e67bcdef5082e9d8a8 2024-05-25T05:37:53.471 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 podman[110884]: 2024-05-25 05:37:53.109874985 +0000 UTC m=+0.017103648 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-05-25T05:37:53.471 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 podman[110884]: 2024-05-25 05:37:53.298167948 +0000 UTC m=+0.205396616 container create ab5822f3e1e4d580e616e1b81b7debe58874dde627c3b5feb63ceaaf08e061cb (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 podman[110884]: 2024-05-25 05:37:53.593172624 +0000 UTC m=+0.500401297 container init ab5822f3e1e4d580e616e1b81b7debe58874dde627c3b5feb63ceaaf08e061cb (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 podman[110884]: 2024-05-25 05:37:53.596243191 +0000 UTC m=+0.503471867 container start ab5822f3e1e4d580e616e1b81b7debe58874dde627c3b5feb63ceaaf08e061cb (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.608Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.609Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.610Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.88 port=9094 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.611Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.635Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.635Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.637Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-05-25T05:37:53.807 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:53.637Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-05-25T05:37:53.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 bash[110884]: ab5822f3e1e4d580e616e1b81b7debe58874dde627c3b5feb63ceaaf08e061cb 2024-05-25T05:37:53.808 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:53 smithi088 systemd[1]: Started Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:37:54.396 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:37:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:37:54] "GET /metrics HTTP/1.1" 200 37917 "" "Prometheus/2.43.0" 2024-05-25T05:37:55.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:55.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.040 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.042 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.043 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.043 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.043 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.043 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.043 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: pgmap v92: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:37:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.901 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:37:55.612Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000680377s 2024-05-25T05:37:55.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.902 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.903 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.904 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.905 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.906 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.907 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.907 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.907 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.907 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.907 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.907 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:55.907 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:37:57.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:57 smithi136 ceph-mon[25618]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:57.221 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:57 smithi088 ceph-mon[29649]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:57.221 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:57 smithi088 ceph-mon[24736]: pgmap v93: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:37:59.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:59 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:59.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:37:59 smithi088 ceph-mon[29649]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:59 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:59.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:37:59 smithi088 ceph-mon[24736]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:37:59.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:59 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:37:59.423 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:37:59 smithi136 ceph-mon[25618]: pgmap v94: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:00.277 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:00 smithi088 ceph-mon[29649]: Upgrade: Updating alertmanager.a 2024-05-25T05:38:00.277 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:00 smithi088 ceph-mon[29649]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:38:00.277 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:00.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:00 smithi088 ceph-mon[24736]: Upgrade: Updating alertmanager.a 2024-05-25T05:38:00.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:00 smithi088 ceph-mon[24736]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:38:00.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:00 smithi136 ceph-mon[25618]: Upgrade: Updating alertmanager.a 2024-05-25T05:38:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:00 smithi136 ceph-mon[25618]: Deploying daemon alertmanager.a on smithi088 2024-05-25T05:38:00.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:01.258 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:01 smithi088 ceph-mon[29649]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:01.259 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:01 smithi088 ceph-mon[24736]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:01.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:01 smithi136 ceph-mon[25618]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:03.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:02 smithi088 systemd[1]: Stopping Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:38:03.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[24736]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:03.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[29649]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:03.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.359 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:02 smithi136 ceph-mon[25618]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:03.359 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.360 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.360 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:03.453 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:38:03.337Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:38:03.453 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:03 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[110899]: ts=2024-05-25T05:38:03.337Z caller=cluster.go:690 level=info component=cluster msg="gossip not settled but continuing anyway" polls=4 elapsed=9.72566821s 2024-05-25T05:38:03.806 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:03 smithi088 podman[112123]: 2024-05-25 05:38:03.687021876 +0000 UTC m=+0.721952196 container died ab5822f3e1e4d580e616e1b81b7debe58874dde627c3b5feb63ceaaf08e061cb (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:38:04.281 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:04 smithi088 podman[112123]: 2024-05-25 05:38:04.189875321 +0000 UTC m=+1.224805640 container cleanup ab5822f3e1e4d580e616e1b81b7debe58874dde627c3b5feb63ceaaf08e061cb (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:38:04.281 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:04 smithi088 bash[112123]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a 2024-05-25T05:38:04.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:38:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:38:04] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.43.0" 2024-05-25T05:38:04.557 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:04 smithi088 podman[112163]: 2024-05-25 05:38:04.408430961 +0000 UTC m=+1.045374065 container remove ab5822f3e1e4d580e616e1b81b7debe58874dde627c3b5feb63ceaaf08e061cb (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:38:04.557 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:04 smithi088 podman[112163]: 2024-05-25 05:38:04.492527138 +0000 UTC m=+1.129470221 volume remove c22bac9393fc8a8b319835fda2941a299e1090790b9de6e67bcdef5082e9d8a8 2024-05-25T05:38:05.048 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:04 smithi088 ceph-mon[29649]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:05.048 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:04 smithi088 ceph-mon[24736]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:04 smithi136 ceph-mon[25618]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:05.799 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:05 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-25T05:38:05.800 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:05 smithi088 systemd[1]: Stopped Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:38:05.800 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:05 smithi088 systemd[1]: Starting Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:38:06.056 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:05 smithi088 podman[112495]: 2024-05-25 05:38:05.753035222 +0000 UTC m=+0.019753406 image pull c8568f914cd25b2062c44e9f79f9c18da6e3b85fe0c47a12a2191c61426c2b19 quay.io/prometheus/alertmanager:v0.25.0 2024-05-25T05:38:06.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:05 smithi088 podman[112495]: 2024-05-25 05:38:05.872160157 +0000 UTC m=+0.138878331 volume create c00d1aa125a6555b685459c4c9e90e84d71c6b889d9ae0f2532a3b16a3d12651 2024-05-25T05:38:06.057 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:05 smithi088 podman[112495]: 2024-05-25 05:38:05.964229765 +0000 UTC m=+0.230947960 container create 5a72ab1af946e5af80dafa0ebe7377a1c64c9ebefea383087f825d23c9106972 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:38:06.485 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 podman[112495]: 2024-05-25 05:38:06.283829407 +0000 UTC m=+0.550547584 container init 5a72ab1af946e5af80dafa0ebe7377a1c64c9ebefea383087f825d23c9106972 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:38:06.485 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 podman[112495]: 2024-05-25 05:38:06.28694105 +0000 UTC m=+0.553659231 container start 5a72ab1af946e5af80dafa0ebe7377a1c64c9ebefea383087f825d23c9106972 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:38:06.486 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.299Z caller=main.go:240 level=info msg="Starting Alertmanager" version="(version=0.25.0, branch=HEAD, revision=258fab7cdd551f2cf251ed0348f0ad7289aee789)" 2024-05-25T05:38:06.486 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.299Z caller=main.go:241 level=info build_context="(go=go1.19.4, user=root@abe866dd5717, date=20221222-14:51:36)" 2024-05-25T05:38:06.486 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.300Z caller=cluster.go:185 level=info component=cluster msg="setting advertise address explicitly" addr=172.21.15.88 port=9094 2024-05-25T05:38:06.486 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.302Z caller=cluster.go:681 level=info component=cluster msg="Waiting for gossip to settle..." interval=2s 2024-05-25T05:38:06.486 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.325Z caller=coordinator.go:113 level=info component=configuration msg="Loading configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:38:06.486 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.325Z caller=coordinator.go:126 level=info component=configuration msg="Completed loading of configuration file" file=/etc/alertmanager/alertmanager.yml 2024-05-25T05:38:06.487 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.328Z caller=tls_config.go:232 level=info msg="Listening on" address=[::]:9093 2024-05-25T05:38:06.487 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:06.328Z caller=tls_config.go:235 level=info msg="TLS is disabled." http2=false address=[::]:9093 2024-05-25T05:38:06.487 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 bash[112495]: 5a72ab1af946e5af80dafa0ebe7377a1c64c9ebefea383087f825d23c9106972 2024-05-25T05:38:06.487 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:06 smithi088 systemd[1]: Started Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:38:06.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:06.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:06.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:06 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-05-25T05:38:06.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:06.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:06.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:06.750 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 854 B/s rd, 0 op/s 2024-05-25T05:38:06.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.752 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:06.752 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:06.752 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:06.752 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:06.752 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:06 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:07 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:38:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-alertmanager-api-host"}]: dispatch 2024-05-25T05:38:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:07 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.566 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:08 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:08.302Z caller=cluster.go:706 level=info component=cluster msg="gossip not settled" polls=0 before=0 now=1 elapsed=2.000912757s 2024-05-25T05:38:08.618 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:08 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.334 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:38:09.334 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 3s ago 29m - - 2024-05-25T05:38:09.334 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 7s ago 29m - - 2024-05-25T05:38:09.334 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 starting - - - - 2024-05-25T05:38:09.334 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (15m) 7s ago 23m 54.7M - 8.3.5 dad864ee21e9 f5db15f1314a 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (2m) 3s ago 23m 53.3M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (2m) 7s ago 28m 453M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (13m) 3s ago 30m 522M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (30m) 3s ago 30m 96.0M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (29m) 7s ago 29m 70.9M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (29m) 3s ago 29m 69.2M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (93s) 3s ago 24m 8070k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (89s) 7s ago 24m 15.1M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (28m) 3s ago 28m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:38:09.335 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (28m) 3s ago 28m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (27m) 3s ago 27m 50.5M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (27m) 3s ago 27m 56.3M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (26m) 7s ago 26m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (26m) 7s ago 26m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (26m) 7s ago 26m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (25m) 7s ago 25m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (42s) 7s ago 25m 56.9M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:38:09.336 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (23m) 3s ago 23m 77.4M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:38:09.337 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (23m) 7s ago 23m 78.8M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:38:09.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.727 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.728 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:09.729 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.730 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.731 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.732 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.732 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.732 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.732 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.732 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.732 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:09.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.733 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.736 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.736 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.736 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.736 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.736 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.736 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.736 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.780 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:38:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:38:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:38:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:09.780 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:38:09.781 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:38:09.782 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='client.15687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='client.15693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.146 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:38:10.146 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:38:10.146 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading alertmanager daemons", 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:38:10.147 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='client.15699 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.733 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.734 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3009211574' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='client.15699 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:10.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3009211574' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:10 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='client.15699 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3009211574' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:10 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='client.15711 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='client.15711 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:11 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='client.15711 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:11 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:12 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:12 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:13 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:13.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:13.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:13.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:13.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:13.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:13 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:38:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:38:14] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.43.0" 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.786 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.787 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.788 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:14.789 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:15 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 936 B/s rd, 0 op/s 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:15 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.556 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:38:16.306Z caller=cluster.go:698 level=info component=cluster msg="gossip settled; proceeding" elapsed=10.00410614s 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:16 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.838 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.839 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.840 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.841 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:16.842 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:16 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:17.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:17 smithi088 ceph-mon[24736]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:38:17.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:17 smithi088 ceph-mon[29649]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:38:17.851 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:17 smithi136 ceph-mon[25618]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.4 KiB/s rd, 1 op/s 2024-05-25T05:38:18.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:18.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[24736]: Upgrade: Updating grafana.a 2024-05-25T05:38:18.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[24736]: Deploying daemon grafana.a on smithi136 2024-05-25T05:38:18.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.665 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.666 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.666 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:18.666 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[29649]: Upgrade: Updating grafana.a 2024-05-25T05:38:18.666 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[29649]: Deploying daemon grafana.a on smithi136 2024-05-25T05:38:18.666 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.666 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.666 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:18 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:18 smithi136 ceph-mon[25618]: Upgrade: Updating grafana.a 2024-05-25T05:38:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:18 smithi136 ceph-mon[25618]: Deploying daemon grafana.a on smithi136 2024-05-25T05:38:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:19.853 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:19 smithi088 ceph-mon[24736]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:19.853 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:19 smithi088 ceph-mon[29649]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:20.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:19 smithi136 ceph-mon[25618]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:22.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:21 smithi136 ceph-mon[25618]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:22.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:21 smithi088 ceph-mon[29649]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:21 smithi088 ceph-mon[24736]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:23.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:23 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:24 smithi088 ceph-mon[24736]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:24.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:24 smithi088 ceph-mon[29649]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:24.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:24 smithi136 ceph-mon[25618]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:24.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:38:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:38:24] "GET /metrics HTTP/1.1" 200 37916 "" "Prometheus/2.43.0" 2024-05-25T05:38:26.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:26 smithi088 ceph-mon[24736]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:26.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:26 smithi088 ceph-mon[29649]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:26.342 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:26 smithi136 ceph-mon[25618]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:28 smithi136 ceph-mon[25618]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:28.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:28 smithi088 ceph-mon[24736]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:28 smithi088 ceph-mon[29649]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:28.574 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:28 smithi136 systemd[1]: Stopping Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:38:28.841 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:28 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[55524]: t=2024-05-25T05:38:28+0000 lvl=info msg="Shutdown started" logger=server reason="System signal: terminated" 2024-05-25T05:38:28.841 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:28 smithi136 podman[102786]: 2024-05-25 05:38:28.585006791 +0000 UTC m=+0.117160722 container died f5db15f1314a566f8269268c6efd334e9249e871c0977f23339a5d59be551c0a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, io.openshift.tags=base rhel8, name=ubi8, build-date=2022-03-28T10:36:18.413762, description=Ceph Grafana Container, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, release=236.1648460182, vcs-type=git, io.buildah.version=1.24.2, io.openshift.expose-services=, summary=Grafana Container configured for Ceph mgr/dashboard integration, version=8.5, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., architecture=x86_64, io.k8s.display-name=Red Hat Universal Base Image 8, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, maintainer=Paul Cuzner , distribution-scope=public) 2024-05-25T05:38:29.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:29 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:29.135 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:28 smithi136 podman[102786]: 2024-05-25 05:38:28.933115138 +0000 UTC m=+0.465269060 container cleanup f5db15f1314a566f8269268c6efd334e9249e871c0977f23339a5d59be551c0a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, build-date=2022-03-28T10:36:18.413762, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., version=8.5, name=ubi8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, release=236.1648460182, vcs-type=git, vendor=Red Hat, Inc., distribution-scope=public, io.k8s.display-name=Red Hat Universal Base Image 8, io.openshift.tags=base rhel8, io.buildah.version=1.24.2, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, architecture=x86_64, maintainer=Paul Cuzner , summary=Grafana Container configured for Ceph mgr/dashboard integration, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, description=Ceph Grafana Container) 2024-05-25T05:38:29.135 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:28 smithi136 bash[102786]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a 2024-05-25T05:38:29.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:29 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:29.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:29 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:29.554 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:29 smithi136 podman[102800]: 2024-05-25 05:38:29.234860322 +0000 UTC m=+0.651046741 container remove f5db15f1314a566f8269268c6efd334e9249e871c0977f23339a5d59be551c0a (image=quay.io/ceph/ceph-grafana:8.3.5, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, io.openshift.expose-services=, vcs-ref=3aadd00326f3dd6cfe65ee31017ab98915fddb56, distribution-scope=public, io.openshift.tags=base rhel8, vcs-type=git, build-date=2022-03-28T10:36:18.413762, summary=Grafana Container configured for Ceph mgr/dashboard integration, io.k8s.display-name=Red Hat Universal Base Image 8, version=8.5, com.redhat.license_terms=https://www.redhat.com/en/about/red-hat-end-user-license-agreements#UBI, io.buildah.version=1.24.2, architecture=x86_64, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=Ceph Grafana Container, maintainer=Paul Cuzner , name=ubi8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.5-236.1648460182, com.redhat.component=ubi8-container, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=236.1648460182, vendor=Red Hat, Inc.) 2024-05-25T05:38:29.554 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:29 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Deactivated successfully. 2024-05-25T05:38:29.554 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:29 smithi136 systemd[1]: Stopped Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:38:29.554 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:29 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Consumed 5.774s CPU time. 2024-05-25T05:38:29.554 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:29 smithi136 systemd[1]: Starting Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:38:29.884 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:29 smithi136 podman[102925]: 2024-05-25 05:38:29.670751501 +0000 UTC m=+0.018157250 image pull 2bacad6d85d802cd176c146528adcc0e47a8a83e94bc4a8b7ba1a9b9ef2c65e7 quay.io/ceph/grafana:9.4.12 2024-05-25T05:38:29.884 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:29 smithi136 podman[102925]: 2024-05-25 05:38:29.794396411 +0000 UTC m=+0.141802135 container create 84da0f7779045feba269e2246979e78762d64013a996ddf3792825ed99c4a238 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:30.162 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:30 smithi136 ceph-mon[25618]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:30.162 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:30 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:30.163 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 podman[102925]: 2024-05-25 05:38:30.005420827 +0000 UTC m=+0.352826564 container init 84da0f7779045feba269e2246979e78762d64013a996ddf3792825ed99c4a238 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:30.163 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 podman[102925]: 2024-05-25 05:38:30.008223499 +0000 UTC m=+0.355629235 container start 84da0f7779045feba269e2246979e78762d64013a996ddf3792825ed99c4a238 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:30.163 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 bash[102925]: 84da0f7779045feba269e2246979e78762d64013a996ddf3792825ed99c4a238 2024-05-25T05:38:30.163 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 systemd[1]: Started Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:38:30.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:30 smithi088 ceph-mon[29649]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:30 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:30 smithi088 ceph-mon[24736]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 852 B/s rd, 0 op/s 2024-05-25T05:38:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:30 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:30.446 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.162748436Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.162971465Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.162986381Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.162991444Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.162995276Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.162999036Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163002496Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163005977Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163009582Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.16301374Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-05-25T05:38:30.447 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163017463Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-05-25T05:38:30.448 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163021045Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-05-25T05:38:30.448 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163024742Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-05-25T05:38:30.448 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163029083Z level=info msg="Path Home" path=/usr/share/grafana 2024-05-25T05:38:30.448 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.16303254Z level=info msg="Path Data" path=/var/lib/grafana 2024-05-25T05:38:30.448 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.16303595Z level=info msg="Path Logs" path=/var/log/grafana 2024-05-25T05:38:30.448 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163042576Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-05-25T05:38:30.448 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.163046235Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=settings t=2024-05-25T05:38:30.16304997Z level=info msg="App mode production" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=sqlstore t=2024-05-25T05:38:30.163100843Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=sqlstore t=2024-05-25T05:38:30.163116019Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.1749102Z level=info msg="Starting DB migrations" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.178323706Z level=info msg="Executing migration" id="Update is_service_account column to nullable" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.190252919Z level=info msg="Executing migration" id="Add isPublic for dashboard" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.191737074Z level=info msg="Executing migration" id="set service account foreign key to nil if 0" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.194052Z level=info msg="Executing migration" id="Add last_used_at to api_key table" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.196631368Z level=info msg="Executing migration" id="Add is_revoked column to api_key table" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.199071886Z level=info msg="Executing migration" id="Add column preferences.json_data" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.201607893Z level=info msg="Executing migration" id="alter preferences.json_data to mediumtext v1" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.204131858Z level=info msg="Executing migration" id="Add preferences index org_id" 2024-05-25T05:38:30.450 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.206718334Z level=info msg="Executing migration" id="Add preferences index user_id" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.209271478Z level=info msg="Executing migration" id="Increase tags column to length 4096" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.211692702Z level=info msg="Executing migration" id="Add OAuth ID token to user_auth" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.214211571Z level=info msg="Executing migration" id="alter table short_url alter column created_by type to bigint" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.216608269Z level=info msg="Executing migration" id="add current_reason column related to current_state" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.217778106Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.220208122Z level=info msg="Executing migration" id="add is_paused column to alert_rule table" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.222524154Z level=info msg="Executing migration" id="fix is_paused column for alert_rule table" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.22497786Z level=info msg="Executing migration" id="add rule_group_idx column to alert_rule_version" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.226051611Z level=info msg="Executing migration" id="add is_paused column to alert_rule_versions table" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.228573168Z level=info msg="Executing migration" id="fix is_paused column for alert_rule_version table" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.230941781Z level=info msg="Executing migration" id="add configuration_hash column to alert_configuration" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.233395279Z level=info msg="Executing migration" id="add column send_alerts_to in ngalert_configuration" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.234645664Z level=info msg="Executing migration" id="create provenance_type table" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.23581054Z level=info msg="Executing migration" id="add index to uniquify (record_key, record_type, org_id) columns" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.236851048Z level=info msg="Executing migration" id="create alert_image table" 2024-05-25T05:38:30.451 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.23772067Z level=info msg="Executing migration" id="add unique index on token to alert_image table" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.238147512Z level=info msg="Executing migration" id="support longer URLs in alert_image table" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.239280136Z level=info msg="Executing migration" id=create_alert_configuration_history_table 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.240498263Z level=info msg="Executing migration" id="drop non-unique orgID index on alert_configuration" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.241195172Z level=info msg="Executing migration" id="drop unique orgID index on alert_configuration if exists" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.241417311Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop unique orgID index on alert_configuration if exists" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.241729443Z level=info msg="Executing migration" id="extract alertmanager configuration history to separate table" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.242692232Z level=info msg="Executing migration" id="add unique index on orgID to alert_configuration" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.243784921Z level=info msg="Executing migration" id="increase max description length to 2048" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.244665403Z level=info msg="Executing migration" id="create secrets table" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.245103333Z level=info msg="Executing migration" id="rename data_keys name column to id" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.251361106Z level=info msg="Executing migration" id="add name column into data_keys" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.252540983Z level=info msg="Executing migration" id="copy data_keys id column values into name" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.253562334Z level=info msg="Executing migration" id="rename data_keys name column to label" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.260210236Z level=info msg="Executing migration" id="rename data_keys id column back to name" 2024-05-25T05:38:30.452 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.266510895Z level=info msg="Executing migration" id="add column hidden to role table" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.267669501Z level=info msg="Executing migration" id="create query_history table v1" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.268697471Z level=info msg="Executing migration" id="add index query_history.org_id-created_by-datasource_uid" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.269179188Z level=info msg="Executing migration" id="alter table query_history alter column created_by type to bigint" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.270129828Z level=info msg="Executing migration" id="teams permissions migration" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.271191465Z level=info msg="Executing migration" id="dashboard permissions" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.272558289Z level=info msg="Executing migration" id="dashboard permissions uid scopes" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.273248991Z level=info msg="Executing migration" id="drop managed folder create actions" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.27420388Z level=info msg="Executing migration" id="alerting notification permissions" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.275165808Z level=info msg="Executing migration" id="create query_history_star table v1" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.276303938Z level=info msg="Executing migration" id="add index query_history.user_id-query_uid" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.276774232Z level=info msg="Executing migration" id="add column org_id in query_history_star" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.277910922Z level=info msg="Executing migration" id="alter table query_history_star_mig column user_id type to bigint" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.278967419Z level=info msg="Executing migration" id="create correlation table v1" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.280012594Z level=info msg="Executing migration" id="add index correlations.uid" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.28046469Z level=info msg="Executing migration" id="add index correlations.source_uid" 2024-05-25T05:38:30.453 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.281588136Z level=info msg="Executing migration" id="add correlation config column" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.282767335Z level=info msg="Executing migration" id="create entity_events table" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.283886535Z level=info msg="Executing migration" id="create dashboard public config v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.284309968Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.284396464Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index UQE_dashboard_public_config_uid - v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.285254937Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.285334124Z level=warn msg="Skipping migration: Already executed, but not recorded in migration log" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.2864327Z level=info msg="Executing migration" id="Drop old dashboard public config table" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.287339178Z level=info msg="Executing migration" id="recreate dashboard public config v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.287837981Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.288317219Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v1" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.290780448Z level=info msg="Executing migration" id="drop index UQE_dashboard_public_config_uid - v2" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.291233801Z level=info msg="Executing migration" id="drop index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-05-25T05:38:30.454 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.291631016Z level=info msg="Executing migration" id="Drop public config table" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.292029449Z level=info msg="Executing migration" id="Recreate dashboard public config v2" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.292455558Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_uid - v2" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.292868015Z level=info msg="Executing migration" id="create index IDX_dashboard_public_config_org_id_dashboard_uid - v2" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.293301206Z level=info msg="Executing migration" id="create index UQE_dashboard_public_config_access_token - v2" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.2937438Z level=info msg="Executing migration" id="Rename table dashboard_public_config to dashboard_public - v2" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.297492682Z level=info msg="Executing migration" id="add annotations_enabled column" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.298724844Z level=info msg="Executing migration" id="add time_selection_enabled column" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.299867849Z level=info msg="Executing migration" id="delete orphaned public dashboards" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.300189149Z level=info msg="Executing migration" id="add share column" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.301400838Z level=info msg="Executing migration" id="create default alerting folders" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.303615095Z level=info msg="Executing migration" id="create file table" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.304072025Z level=info msg="Executing migration" id="file table idx: path natural pk" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.304501594Z level=info msg="Executing migration" id="file table idx: parent_folder_path_hash fast folder retrieval" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.304921852Z level=info msg="Executing migration" id="create file_meta table" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.305304459Z level=info msg="Executing migration" id="file table idx: path key" 2024-05-25T05:38:30.455 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.305734466Z level=info msg="Executing migration" id="set path collation in file table" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.308326264Z level=info msg="Executing migration" id="managed permissions migration" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.309443576Z level=info msg="Executing migration" id="managed folder permissions alert actions migration" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.311961892Z level=info msg="Executing migration" id="RBAC action name migrator" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.314369735Z level=info msg="Executing migration" id="Add UID column to playlist" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.316739849Z level=info msg="Executing migration" id="Update uid column values in playlist" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.317097962Z level=info msg="Executing migration" id="Add index for uid in playlist" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.318183845Z level=info msg="Executing migration" id="update group index for alert rules" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.319237781Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated migration" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.320307074Z level=info msg="Executing migration" id="admin only folder/dashboard permission" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.320867722Z level=info msg="Executing migration" id="add action column to seed_assignment" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.32204476Z level=info msg="Executing migration" id="add scope column to seed_assignment" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.323267201Z level=info msg="Executing migration" id="remove unique index builtin_role_role_name before nullable update" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.323707374Z level=info msg="Executing migration" id="update seed_assignment role_name column to nullable" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.33716908Z level=info msg="Executing migration" id="add unique index builtin_role_name back" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.337690097Z level=info msg="Executing migration" id="add unique index builtin_role_action_scope" 2024-05-25T05:38:30.456 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.338741102Z level=info msg="Executing migration" id="add primary key to seed_assigment" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.343368177Z level=info msg="Executing migration" id="managed folder permissions alert actions repeated fixed migration" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.344425405Z level=info msg="Executing migration" id="migrate external alertmanagers to datsourcse" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.345464543Z level=info msg="Executing migration" id="create folder table" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.346252774Z level=info msg="Executing migration" id="Add index for parent_uid" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.346720444Z level=info msg="Executing migration" id="Add unique index for folder.uid and folder.org_id" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.347791504Z level=info msg="Executing migration" id="Update folder title length" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.348650735Z level=info msg="Executing migration" id="Add unique index for folder.title and folder.parent_uid" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=migrator t=2024-05-25T05:38:30.34967367Z level=info msg="migrations completed" performed=105 skipped=376 duration=171.398152ms 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=sqlstore t=2024-05-25T05:38:30.350001386Z level=info msg="Created default organization" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=plugin.finder t=2024-05-25T05:38:30.381737106Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=secrets t=2024-05-25T05:38:30.381851184Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=query_data t=2024-05-25T05:38:30.385357032Z level=info msg="Query Service initialization" 2024-05-25T05:38:30.457 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:30 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=live.push_http t=2024-05-25T05:38:30.387928266Z level=info msg="Live Push Gateway initialization" 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=infra.usagestats.collector t=2024-05-25T05:38:31.04700376Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=provisioning.datasources t=2024-05-25T05:38:31.048763289Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=provisioning.datasources t=2024-05-25T05:38:31.04877426Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=provisioning.datasources t=2024-05-25T05:38:31.048889625Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=provisioning.alerting t=2024-05-25T05:38:31.073326836Z level=info msg="starting to provision alerting" 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=provisioning.alerting t=2024-05-25T05:38:31.073344943Z level=info msg="finished to provision alerting" 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=ngalert.state.manager t=2024-05-25T05:38:31.073520084Z level=info msg="Warming state cache for startup" 2024-05-25T05:38:31.281 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=grafanaStorageLogger t=2024-05-25T05:38:31.073534523Z level=info msg="storage starting" 2024-05-25T05:38:31.282 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=http.server t=2024-05-25T05:38:31.07726656Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-05-25T05:38:31.282 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=ngalert.state.manager t=2024-05-25T05:38:31.088235231Z level=info msg="State cache has been initialized" states=0 duration=14.712341ms 2024-05-25T05:38:31.282 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=ticker t=2024-05-25T05:38:31.088305197Z level=info msg=starting first_tick=2024-05-25T05:38:40Z 2024-05-25T05:38:31.282 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=ngalert.multiorg.alertmanager t=2024-05-25T05:38:31.088319778Z level=info msg="starting MultiOrg Alertmanager" 2024-05-25T05:38:31.282 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=sqlstore.transactions t=2024-05-25T05:38:31.102566692Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=0 code="database is locked" 2024-05-25T05:38:31.282 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=sqlstore.transactions t=2024-05-25T05:38:31.113809656Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=1 code="database is locked" 2024-05-25T05:38:31.282 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=sqlstore.transactions t=2024-05-25T05:38:31.125342909Z level=info msg="Database locked, sleeping then retrying" error="database is locked" retry=2 code="database is locked" 2024-05-25T05:38:31.282 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.282 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.283 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.284 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:31 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: pgmap v111: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:31.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:31.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:31.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:31.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:31.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:31.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:31 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.254 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.255 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:32 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:32.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:32.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:32.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:32.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:32.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:32.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:32 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.469 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.472 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:33 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: pgmap v112: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:33.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:33.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:33 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.507 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.508 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.509 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.510 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.511 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.512 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:34 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:38:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:38:34] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.43.0" 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:34.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:34.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:34.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:34.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:34.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:34.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:34 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.455 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.456 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.457 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.458 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.459 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.460 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.461 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.462 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.463 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.464 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.464 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.464 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.464 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.566 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.566 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.566 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.566 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: pgmap v113: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.569 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.570 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:35.571 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:35.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:35.572 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:35 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.473 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.474 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.475 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.476 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.477 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.478 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:36 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:36.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:36.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:36.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:36.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:36.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:36.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.387 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.388 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.389 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: pgmap v114: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:37.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:37.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:37.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:37.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:37.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:37.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.414 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.414 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.414 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.414 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.414 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.415 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.416 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.417 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.418 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.418 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:38 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:38.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:38 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: pgmap v115: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:39.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:39.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:39.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.528 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.528 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.529 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.530 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.531 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.532 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.533 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.535 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.536 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.537 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.538 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.539 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.539 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.539 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.539 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.539 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:40 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.539 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:38:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:40.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:40 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:38:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 2s ago 30m - - 2024-05-25T05:38:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 19s ago 29m - - 2024-05-25T05:38:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (35s) 2s ago 24m 15.4M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:38:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 starting - - - - 2024-05-25T05:38:41.282 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (3m) 2s ago 23m 53.5M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (2m) 19s ago 29m 453M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (13m) 2s ago 30m 530M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (31m) 2s ago 31m 96.6M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (29m) 19s ago 29m 71.0M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (29m) 2s ago 29m 69.6M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (2m) 2s ago 25m 8740k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (2m) 19s ago 25m 15.4M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (29m) 2s ago 29m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (28m) 2s ago 28m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (28m) 2s ago 28m 50.6M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (27m) 2s ago 27m 56.3M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (27m) 19s ago 27m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:38:41.283 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (27m) 19s ago 27m 52.3M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:38:41.284 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (26m) 19s ago 26m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:38:41.284 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (26m) 19s ago 26m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:38:41.284 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (74s) 19s ago 25m 60.7M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:38:41.284 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (24m) 2s ago 23m 77.6M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:38:41.284 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (23m) 19s ago 23m 78.9M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:38:41.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:41.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='client.15717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='client.25615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.288 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='client.15717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='client.25615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.530 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.531 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: pgmap v116: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='client.15717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.532 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='client.25615 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.533 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:41.534 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:41.730 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:38:41.730 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:38:41.731 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:38:41.732 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:38:41.732 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:38:42.098 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:38:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:38:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:38:42.098 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mgr", 2024-05-25T05:38:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [ 2024-05-25T05:38:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr" 2024-05-25T05:38:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: ], 2024-05-25T05:38:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "2/2 daemons upgraded", 2024-05-25T05:38:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading grafana daemons", 2024-05-25T05:38:42.099 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:38:42.099 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='client.25621 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.250 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3654990426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.251 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.252 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.253 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:42 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='client.25621 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.322 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3654990426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='client.25621 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.323 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.324 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3654990426' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.327 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:42.328 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[24736]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:43 smithi088 ceph-mon[29649]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:43.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='client.15741 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:43.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:43 smithi136 ceph-mon[25618]: pgmap v117: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:44.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:38:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:38:44] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.43.0" 2024-05-25T05:38:45.067 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:45.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:38:46.050 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:45 smithi136 ceph-mon[25618]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:46.050 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.050 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.050 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[24736]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:46.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[29649]: pgmap v118: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:46.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:46.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[24736]: Upgrade: Updating grafana.a 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[24736]: Deploying daemon grafana.a on smithi136 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[24736]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[29649]: Upgrade: Updating grafana.a 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[29649]: Deploying daemon grafana.a on smithi136 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:47 smithi088 ceph-mon[29649]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:47.868 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:47 smithi136 ceph-mon[25618]: Upgrade: Updating grafana.a 2024-05-25T05:38:47.868 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:47 smithi136 ceph-mon[25618]: Deploying daemon grafana.a on smithi136 2024-05-25T05:38:47.868 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.868 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.868 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:47 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:47.868 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:47 smithi136 ceph-mon[25618]: pgmap v119: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:48.699 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:48 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:48.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:48 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:48 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:50.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:49 smithi136 ceph-mon[25618]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:50.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:49 smithi088 ceph-mon[24736]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:50.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:49 smithi088 ceph-mon[29649]: pgmap v120: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:51.753 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:51 smithi136 systemd[1]: Stopping Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:38:52.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:51 smithi136 ceph-mon[25618]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:52.029 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=server t=2024-05-25T05:38:51.754137829Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-05-25T05:38:52.029 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=tracing t=2024-05-25T05:38:51.754484383Z level=info msg="Closing tracing" 2024-05-25T05:38:52.029 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[102940]: logger=ticker t=2024-05-25T05:38:51.754486262Z level=info msg=stopped last_tick=2024-05-25T05:38:50Z 2024-05-25T05:38:52.029 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:51 smithi136 podman[107618]: 2024-05-25 05:38:51.764431008 +0000 UTC m=+0.123824670 container died 84da0f7779045feba269e2246979e78762d64013a996ddf3792825ed99c4a238 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:52.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:51 smithi088 ceph-mon[24736]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:52.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:51 smithi088 ceph-mon[29649]: pgmap v121: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:52.384 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 podman[107618]: 2024-05-25 05:38:52.112621901 +0000 UTC m=+0.472015564 container cleanup 84da0f7779045feba269e2246979e78762d64013a996ddf3792825ed99c4a238 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:52.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 bash[107618]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a 2024-05-25T05:38:52.741 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 podman[107632]: 2024-05-25 05:38:52.405521405 +0000 UTC m=+0.638087476 container remove 84da0f7779045feba269e2246979e78762d64013a996ddf3792825ed99c4a238 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:52.741 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Deactivated successfully. 2024-05-25T05:38:52.741 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 systemd[1]: Stopped Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:38:52.741 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Consumed 2.613s CPU time. 2024-05-25T05:38:53.079 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 systemd[1]: Starting Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:38:53.079 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 podman[107756]: 2024-05-25 05:38:52.858880409 +0000 UTC m=+0.017796688 image pull 2bacad6d85d802cd176c146528adcc0e47a8a83e94bc4a8b7ba1a9b9ef2c65e7 quay.io/ceph/grafana:9.4.12 2024-05-25T05:38:53.079 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:52 smithi136 podman[107756]: 2024-05-25 05:38:52.96571816 +0000 UTC m=+0.124634411 container create 6a7a56a667d5b8a90f047417ad3920b4f3ec284b0cc555ad61299aec45bc3cb3 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 podman[107756]: 2024-05-25 05:38:53.185039738 +0000 UTC m=+0.343956002 container init 6a7a56a667d5b8a90f047417ad3920b4f3ec284b0cc555ad61299aec45bc3cb3 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 podman[107756]: 2024-05-25 05:38:53.18780029 +0000 UTC m=+0.346716554 container start 6a7a56a667d5b8a90f047417ad3920b4f3ec284b0cc555ad61299aec45bc3cb3 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 bash[107756]: 6a7a56a667d5b8a90f047417ad3920b4f3ec284b0cc555ad61299aec45bc3cb3 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 systemd[1]: Started Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337151466Z level=info msg="Starting Grafana" version=9.4.12 commit=37ee25ba46 branch=HEAD compiled=2023-05-22T15:58:05Z 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337319763Z level=warn msg="\"sentry\" frontend logging provider is deprecated and will be removed in the next major version. Use \"grafana\" provider instead." 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337330033Z level=info msg="Config loaded from" file=/usr/share/grafana/conf/defaults.ini 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337333148Z level=info msg="Config loaded from" file=/etc/grafana/grafana.ini 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337336118Z level=info msg="Config overridden from command line" arg="default.paths.data=/var/lib/grafana" 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337339246Z level=info msg="Config overridden from command line" arg="default.paths.logs=/var/log/grafana" 2024-05-25T05:38:53.483 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337341833Z level=info msg="Config overridden from command line" arg="default.paths.plugins=/var/lib/grafana/plugins" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337344622Z level=info msg="Config overridden from command line" arg="default.paths.provisioning=/etc/grafana/provisioning" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.3373472Z level=info msg="Config overridden from command line" arg="default.log.mode=console" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337350108Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_DATA=/var/lib/grafana" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337353249Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_LOGS=/var/log/grafana" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337355757Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PLUGINS=/var/lib/grafana/plugins" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337358261Z level=info msg="Config overridden from Environment variable" var="GF_PATHS_PROVISIONING=/etc/grafana/provisioning" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337360848Z level=info msg="Path Home" path=/usr/share/grafana 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337363713Z level=info msg="Path Data" path=/var/lib/grafana 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337366869Z level=info msg="Path Logs" path=/var/log/grafana 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337369306Z level=info msg="Path Plugins" path=/var/lib/grafana/plugins 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337371912Z level=info msg="Path Provisioning" path=/etc/grafana/provisioning 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=settings t=2024-05-25T05:38:53.337374871Z level=info msg="App mode production" 2024-05-25T05:38:53.484 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=sqlstore t=2024-05-25T05:38:53.337418056Z level=info msg="Connecting to DB" dbtype=sqlite3 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=sqlstore t=2024-05-25T05:38:53.337429741Z level=warn msg="SQLite database file has broader permissions than it should" path=/var/lib/grafana/grafana.db mode=-rw-r--r-- expected=-rw-r----- 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=migrator t=2024-05-25T05:38:53.352055673Z level=info msg="Starting DB migrations" 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=migrator t=2024-05-25T05:38:53.356614319Z level=info msg="migrations completed" performed=0 skipped=481 duration=432.186µs 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=sqlstore t=2024-05-25T05:38:53.357071065Z level=info msg="Created default organization" 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=plugin.finder t=2024-05-25T05:38:53.390684196Z level=warn msg="Skipping finding plugins as directory does not exist" path=/usr/share/grafana/plugins-bundled 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=secrets t=2024-05-25T05:38:53.390792937Z level=info msg="Envelope encryption state" enabled=true currentprovider=secretKey.v1 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=query_data t=2024-05-25T05:38:53.393735084Z level=info msg="Query Service initialization" 2024-05-25T05:38:53.485 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=live.push_http t=2024-05-25T05:38:53.397174982Z level=info msg="Live Push Gateway initialization" 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.057 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.058 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:53 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.272 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:54.272 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.273 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.274 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: pgmap v122: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.384 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=infra.usagestats.collector t=2024-05-25T05:38:54.090795819Z level=info msg="registering usage stat providers" usageStatsProvidersLen=2 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=provisioning.datasources t=2024-05-25T05:38:54.09308517Z level=info msg="deleted correlations based on configuration" ds_name=Dashboard1 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=provisioning.datasources t=2024-05-25T05:38:54.093099064Z level=info msg="deleted datasource based on configuration" name=Dashboard1 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=provisioning.datasources t=2024-05-25T05:38:54.093230869Z level=info msg="inserting datasource from configuration " name=Dashboard1 uid=P43CA22E17D0F9596 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=provisioning.alerting t=2024-05-25T05:38:54.12725957Z level=info msg="starting to provision alerting" 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=provisioning.alerting t=2024-05-25T05:38:54.127281082Z level=info msg="finished to provision alerting" 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=grafanaStorageLogger t=2024-05-25T05:38:54.127590904Z level=info msg="storage starting" 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=ngalert.state.manager t=2024-05-25T05:38:54.127636065Z level=info msg="Warming state cache for startup" 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=http.server t=2024-05-25T05:38:54.13057562Z level=info msg="HTTP Server Listen" address=[::]:3000 protocol=https subUrl= socket= 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=ngalert.state.manager t=2024-05-25T05:38:54.13989082Z level=info msg="State cache has been initialized" states=0 duration=12.253067ms 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=ticker t=2024-05-25T05:38:54.139959201Z level=info msg=starting first_tick=2024-05-25T05:39:00Z 2024-05-25T05:38:54.385 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:38:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=ngalert.multiorg.alertmanager t=2024-05-25T05:38:54.139948773Z level=info msg="starting MultiOrg Alertmanager" 2024-05-25T05:38:54.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:38:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:38:54] "GET /metrics HTTP/1.1" 200 37913 "" "Prometheus/2.43.0" 2024-05-25T05:38:54.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:54.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:54.872 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:54.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:54.873 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "dashboard get-grafana-api-url"}]: dispatch 2024-05-25T05:38:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:54 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:55.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:55.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:55.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:55.310 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.141 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.142 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:55 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:56.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: pgmap v123: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.941 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.942 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.943 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.944 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.944 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.944 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.944 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.944 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.945 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.946 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.947 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:56.948 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:56 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.277 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.278 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.279 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.280 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.281 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:57.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:57.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:57.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:57.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:57.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:57 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: pgmap v124: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:38:58.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:58.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:38:59.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:38:59.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:58 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:38:59 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.170 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.171 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.172 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: pgmap v125: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.173 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.174 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.175 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.176 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:38:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.981 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.982 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.983 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:00.984 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:00 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.177 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.178 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.180 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.181 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.182 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.183 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.184 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.185 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:01.186 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:01.187 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:01.187 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:02.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: pgmap v126: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:02.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:01 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.041 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.042 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.043 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.044 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.044 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.044 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:03.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:03.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:02 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:03 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.281 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: pgmap v127: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.284 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.285 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.286 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.287 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.288 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.289 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:04.291 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:04.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:04.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:04.292 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:04.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:39:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:39:04] "GET /metrics HTTP/1.1" 200 37913 "" "Prometheus/2.43.0" 2024-05-25T05:39:05.303 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.303 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.304 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.305 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.306 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.308 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:04 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.311 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.317 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.318 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:05.319 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:05.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:05.320 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Upgrade: Finalizing container_image settings 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:39:06.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: Upgrade: Complete! 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:05 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:06.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Upgrade: Finalizing container_image settings 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:39:06.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: pgmap v128: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Upgrade: Finalizing container_image settings 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:39:06.312 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:39:06.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: Upgrade: Complete! 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:39:06.315 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: Upgrade: Complete! 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:06.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:08.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:07 smithi136 ceph-mon[25618]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:08.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:07 smithi088 ceph-mon[29649]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:08.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:07 smithi088 ceph-mon[24736]: pgmap v129: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:09.276 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:08 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:09.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:08 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:09.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:08 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:10.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:09 smithi088 ceph-mon[29649]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:10.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:09 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:10.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:09 smithi088 ceph-mon[24736]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:10.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:09 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:10.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:09 smithi136 ceph-mon[25618]: pgmap v130: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:10.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:09 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:12.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:11 smithi088 ceph-mon[29649]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:11 smithi088 ceph-mon[24736]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:12.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:11 smithi136 ceph-mon[25618]: pgmap v131: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:13.178 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.mgr | length == 1'"'"'' 2024-05-25T05:39:14.187 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:13 smithi136 ceph-mon[25618]: from='client.15747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:14.187 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:13 smithi136 ceph-mon[25618]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:14.193 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:13 smithi088 ceph-mon[29649]: from='client.15747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:14.193 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:13 smithi088 ceph-mon[29649]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:14.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:13 smithi088 ceph-mon[24736]: from='client.15747 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:14.193 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:13 smithi088 ceph-mon[24736]: pgmap v132: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:14.477 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:39:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:39:14] "GET /metrics HTTP/1.1" 200 37913 "" "Prometheus/2.43.0" 2024-05-25T05:39:15.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:15.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:15.282 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:39:15.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:14 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:15.884 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.mgr | keys'"'"' | grep $sha1' 2024-05-25T05:39:16.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:15 smithi088 ceph-mon[24736]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:16.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:15 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2326253718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:15 smithi088 ceph-mon[29649]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:16.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:15 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2326253718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:16.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:15 smithi136 ceph-mon[25618]: pgmap v133: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:16.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:15 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2326253718' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:17.995 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)" 2024-05-25T05:39:18.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:17 smithi088 ceph-mon[24736]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:18.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:17 smithi088 ceph-mon[29649]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:17 smithi136 ceph-mon[25618]: pgmap v134: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:18.598 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.overall | length == 2'"'"'' 2024-05-25T05:39:19.135 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:19.135 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3060979709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:19.135 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.135 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.135 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.135 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:19.135 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3060979709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:19.136 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.136 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.136 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:18 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:18 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:19.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:18 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3060979709' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:19.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:19.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:18 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:20.166 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:19 smithi088 ceph-mon[24736]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:20.166 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:19 smithi088 ceph-mon[29649]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:19 smithi136 ceph-mon[25618]: pgmap v135: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:20.965 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:39:22.079 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 2'"'"'' 2024-05-25T05:39:22.104 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:21 smithi088 ceph-mon[24736]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:22.104 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:21 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2792747544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:22.104 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:21 smithi088 ceph-mon[29649]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:22.105 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:21 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2792747544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:22.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:21 smithi136 ceph-mon[25618]: pgmap v136: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:21 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/2792747544' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:24.049 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:23 smithi088 ceph-mon[24736]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:24.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:23 smithi088 ceph-mon[29649]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:24.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:39:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:39:24] "GET /metrics HTTP/1.1" 200 37913 "" "Prometheus/2.43.0" 2024-05-25T05:39:24.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:23 smithi136 ceph-mon[25618]: pgmap v137: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:25 smithi136 ceph-mon[25618]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:25 smithi136 ceph-mon[25618]: from='client.25663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:25 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[29649]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[29649]: from='client.25663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[24736]: pgmap v138: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[24736]: from='client.25663 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:25 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:26.861 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:39:27.522 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade status' 2024-05-25T05:39:28.164 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:27 smithi088 ceph-mon[29649]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:28.165 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:27 smithi088 ceph-mon[24736]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:28.285 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:27 smithi136 ceph-mon[25618]: pgmap v139: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:29.179 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:28 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:29.179 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:28 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:29.343 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:28 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:29.613 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:39:29.613 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": null, 2024-05-25T05:39:29.613 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": false, 2024-05-25T05:39:29.613 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "", 2024-05-25T05:39:29.613 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:39:29.614 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": null, 2024-05-25T05:39:29.614 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-05-25T05:39:29.614 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:39:29.614 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:39:30.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:29 smithi136 ceph-mon[25618]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:30.127 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:29 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:30.231 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:29 smithi088 ceph-mon[24736]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:30.231 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:30.232 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:29 smithi088 ceph-mon[29649]: pgmap v140: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:30.232 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:30.256 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph health detail' 2024-05-25T05:39:31.239 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:30 smithi088 ceph-mon[29649]: from='client.25669 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:31.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:30 smithi088 ceph-mon[24736]: from='client.25669 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:31.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:30 smithi136 ceph-mon[25618]: from='client.25669 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:32.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:31 smithi088 ceph-mon[24736]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:32.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:31 smithi088 ceph-mon[29649]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:31 smithi136 ceph-mon[25618]: pgmap v141: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:32.476 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2024-05-25T05:39:33.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:32 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3101015935' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:39:33.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:32 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3101015935' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:39:33.119 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.x | awk '"'"'{print $2}'"'"')' 2024-05-25T05:39:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:32 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/3101015935' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:39:34.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:33 smithi088 ceph-mon[29649]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:34.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:33 smithi088 ceph-mon[24736]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:33 smithi136 ceph-mon[25618]: pgmap v142: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:34.436 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:39:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:39:34] "GET /metrics HTTP/1.1" 200 37914 "" "Prometheus/2.43.0" 2024-05-25T05:39:36.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:35 smithi088 ceph-mon[29649]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:36.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:35 smithi088 ceph-mon[24736]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:36.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:35 smithi136 ceph-mon[25618]: pgmap v143: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:37.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:36 smithi088 ceph-mon[29649]: from='client.15789 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:37.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:36 smithi088 ceph-mon[29649]: from='client.25687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mon", "hosts": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:36 smithi088 ceph-mon[24736]: from='client.15789 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:36 smithi088 ceph-mon[24736]: from='client.25687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mon", "hosts": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:37.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:36 smithi136 ceph-mon[25618]: from='client.15789 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:36 smithi136 ceph-mon[25618]: from='client.25687 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mon", "hosts": "smithi136", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:37.763 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:39:38.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:37 smithi088 ceph-mon[29649]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:37 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:37 smithi088 ceph-mon[24736]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:37 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:38.375 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-05-25T05:39:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:37 smithi136 ceph-mon[25618]: pgmap v144: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:37 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:38 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:39.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:39.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:38 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:40.294 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:39 smithi088 ceph-mon[29649]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:40.294 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:39 smithi088 ceph-mon[29649]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:39:40.294 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:39 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:40.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:39 smithi088 ceph-mon[24736]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:40.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:39 smithi088 ceph-mon[24736]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:39:40.294 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:39 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:40.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:39 smithi136 ceph-mon[25618]: pgmap v145: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:40.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:39 smithi136 ceph-mon[25618]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:39:40.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:39 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:41.033 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:39:41.704 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 2s ago 31m - - 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 15s ago 30m - - 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (95s) 2s ago 25m 15.7M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (48s) 15s ago 25m 73.6M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (4m) 2s ago 24m 56.9M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (3m) 15s ago 30m 453M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (14m) 2s ago 31m 530M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (32m) 2s ago 32m 101M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (30m) 15s ago 30m 74.3M 2048M 17.2.0 e1d6a67b021e 5dae4d6e986b 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (30m) 2s ago 30m 73.4M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (3m) 2s ago 26m 8451k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (3m) 15s ago 26m 15.1M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (30m) 2s ago 30m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (29m) 2s ago 29m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:39:41.705 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (29m) 2s ago 29m 50.6M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (28m) 2s ago 28m 56.4M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (28m) 15s ago 28m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (28m) 15s ago 28m 52.3M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (27m) 15s ago 27m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (27m) 15s ago 27m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (2m) 15s ago 26m 67.6M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (25m) 2s ago 25m 77.8M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:39:41.706 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (24m) 15s ago 24m 79.1M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:39:42.107 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 3 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:39:42.108 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:39:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:39:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 13, 2024-05-25T05:39:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:39:42.109 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:39:42.109 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:39:42.281 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:42.281 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: from='client.25693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:42.281 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:42.281 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:42.281 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:42.282 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:42.282 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:39:42.282 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:41 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-05-25T05:39:42.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:42.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: from='client.25693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: pgmap v146: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: from='client.25693 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:42.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:42.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:42.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:39:42.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:41 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["b"]}]: dispatch 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi136", 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/1 daemons upgraded", 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:39:42.445 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:39:43.267 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:43 smithi136 ceph-mon[25618]: from='client.15807 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:43.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:43 smithi136 ceph-mon[25618]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:39:43.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:43 smithi136 ceph-mon[25618]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:39:43.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:43 smithi136 ceph-mon[25618]: Upgrade: Setting container_image for all mgr 2024-05-25T05:39:43.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:43 smithi136 ceph-mon[25618]: Upgrade: It appears safe to stop mon.b 2024-05-25T05:39:43.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:43 smithi136 ceph-mon[25618]: from='client.15813 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:43.268 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:43 smithi136 ceph-mon[25618]: from='client.? 172.21.15.88:0/1103060526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[29649]: from='client.15807 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[29649]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[29649]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all mgr 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[29649]: Upgrade: It appears safe to stop mon.b 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[29649]: from='client.15813 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1103060526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[24736]: from='client.15807 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:43.275 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[24736]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:39:43.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[24736]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:39:43.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all mgr 2024-05-25T05:39:43.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[24736]: Upgrade: It appears safe to stop mon.b 2024-05-25T05:39:43.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[24736]: from='client.15813 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:43.276 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:43 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1103060526' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:44.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:44 smithi136 ceph-mon[25618]: from='client.25717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:44 smithi136 ceph-mon[25618]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:39:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:39:44.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:44 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[29649]: from='client.25717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[29649]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:44.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[24736]: from='client.25717 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[24736]: pgmap v147: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:39:44.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:44 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:44.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:39:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:39:44] "GET /metrics HTTP/1.1" 200 37914 "" "Prometheus/2.43.0" 2024-05-25T05:39:45.120 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 ceph-mon[25618]: Upgrade: Updating mon.b 2024-05-25T05:39:45.120 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 ceph-mon[25618]: Deploying daemon mon.b on smithi136 2024-05-25T05:39:45.120 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 ceph-mon[25618]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:45 smithi088 ceph-mon[29649]: Upgrade: Updating mon.b 2024-05-25T05:39:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:45 smithi088 ceph-mon[29649]: Deploying daemon mon.b on smithi136 2024-05-25T05:39:45.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:45 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:45 smithi088 ceph-mon[24736]: Upgrade: Updating mon.b 2024-05-25T05:39:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:45 smithi088 ceph-mon[24736]: Deploying daemon mon.b on smithi136 2024-05-25T05:39:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:45 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:39:45.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 systemd[1]: Stopping Ceph mon.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:39:45.790 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b[25614]: 2024-05-25T05:39:45.455+0000 7f3fad8c4700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:39:45.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b[25614]: 2024-05-25T05:39:45.455+0000 7f3fad8c4700 -1 mon.b@2(peon) e3 *** Got Signal Terminated *** 2024-05-25T05:39:45.791 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 podman[113034]: 2024-05-25 05:39:45.476937192 +0000 UTC m=+0.206833131 container died 5dae4d6e986be817525875820097edddff49a0297185e7cf1450700a3e8cee4f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., io.openshift.expose-services=, GIT_CLEAN=True, ceph=True, release=754, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, com.redhat.component=centos-stream-container, vcs-type=git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-05-25T05:39:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 podman[113034]: 2024-05-25 05:39:45.990019343 +0000 UTC m=+0.719915276 container cleanup 5dae4d6e986be817525875820097edddff49a0297185e7cf1450700a3e8cee4f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, io.openshift.expose-services=, version=8, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, vcs-type=git, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-25T05:39:46.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:45 smithi136 bash[113034]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b 2024-05-25T05:39:46.468 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:46 smithi136 podman[113046]: 2024-05-25 05:39:46.216983407 +0000 UTC m=+0.736345466 container remove 5dae4d6e986be817525875820097edddff49a0297185e7cf1450700a3e8cee4f (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, io.k8s.display-name=CentOS Stream 8, release=754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, vendor=Red Hat, Inc., version=8, maintainer=Guillaume Abrioux , distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, name=centos-stream, com.redhat.component=centos-stream-container, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-05-25T05:39:46.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:46 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.b.service: Deactivated successfully. 2024-05-25T05:39:46.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:46 smithi136 systemd[1]: Stopped Ceph mon.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:39:46.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:46 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.b.service: Consumed 22.227s CPU time. 2024-05-25T05:39:46.881 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:46 smithi136 systemd[1]: Starting Ceph mon.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:39:47.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:46 smithi136 podman[113199]: 2024-05-25 05:39:46.784772401 +0000 UTC m=+0.017734301 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:39:47.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:46 smithi136 podman[113199]: 2024-05-25 05:39:46.893020149 +0000 UTC m=+0.125982026 container create b80204e525b512e2b17049bc2874218d966056516722122a4e872a1dd693a705 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, ceph=True, RELEASE=squid-ea0684c, org.label-schema.build-date=20240521, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-25T05:39:47.447 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 podman[113199]: 2024-05-25 05:39:47.152142314 +0000 UTC m=+0.385104216 container init b80204e525b512e2b17049bc2874218d966056516722122a4e872a1dd693a705 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, GIT_BRANCH=HEAD, RELEASE=squid-ea0684c, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, ceph=True) 2024-05-25T05:39:47.447 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 podman[113199]: 2024-05-25 05:39:47.156863204 +0000 UTC m=+0.389825090 container start b80204e525b512e2b17049bc2874218d966056516722122a4e872a1dd693a705 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , ceph=True) 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: set uid:gid to 167:167 (ceph:ceph) 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc), process ceph-mon, pid 2 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: pidfile_write: ignore empty --pid-file 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: load: jerasure load: lrc 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: RocksDB version: 7.9.2 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Git sha 0 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Compile date 2024-05-23 20:42:41 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: DB SUMMARY 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: DB Session ID: CV4OFM5PJB96OP4PUN3D 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: CURRENT file: CURRENT 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: IDENTITY file: IDENTITY 2024-05-25T05:39:47.448 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: MANIFEST file: MANIFEST-000009 size: 5190 Bytes 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: SST files in /var/lib/ceph/mon/ceph-b/store.db dir, Total Num: 1, files: 000090.sst 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-b/store.db: 000088.log size: 905799 ; 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.error_if_exists: 0 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.create_if_missing: 0 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.paranoid_checks: 1 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.env: 0x55da457e6c60 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.fs: PosixFileSystem 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.info_log: 0x55da46f4db20 2024-05-25T05:39:47.449 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_file_opening_threads: 16 2024-05-25T05:39:47.450 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.statistics: (nil) 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.use_fsync: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_log_file_size: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.keep_log_file_num: 1000 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.recycle_log_file_num: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.allow_fallocate: 1 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.allow_mmap_reads: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.allow_mmap_writes: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.use_direct_reads: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-25T05:39:47.451 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.create_missing_column_families: 0 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.db_log_dir: 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.wal_dir: 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.advise_random_on_open: 1 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.db_write_buffer_size: 0 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.write_buffer_manager: 0x55da46f1e820 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-25T05:39:47.452 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.rate_limiter: (nil) 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.wal_recovery_mode: 2 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.enable_thread_tracking: 0 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.enable_pipelined_write: 0 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.unordered_write: 0 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.row_cache: None 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.wal_filter: None 2024-05-25T05:39:47.453 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.allow_ingest_behind: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.two_write_queues: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.manual_wal_flush: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.wal_compression: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.atomic_flush: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.log_readahead_size: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.best_efforts_recovery: 0 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-25T05:39:47.454 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.allow_data_in_errors: 0 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.db_host_id: __hostname__ 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_background_jobs: 2 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_background_compactions: -1 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_subcompactions: 1 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_total_wal_size: 0 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-25T05:39:47.455 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_open_files: -1 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bytes_per_sync: 0 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_readahead_size: 0 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_background_flushes: -1 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Compression algorithms supported: 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kZSTD supported: 0 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kXpressCompression supported: 0 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kLZ4HCCompression supported: 1 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kZlibCompression supported: 1 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kSnappyCompression supported: 1 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kLZ4Compression supported: 1 2024-05-25T05:39:47.456 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: kBZip2Compression supported: 0 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.merge_operator: 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_filter: None 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_filter_factory: None 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.sst_partitioner_factory: None 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55da46f4dc40) 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout: cache_index_and_filter_blocks: 1 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-25T05:39:47.457 INFO:journalctl@ceph.mon.b.smithi136.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: pin_top_level_index_and_filter: 1 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_type: 0 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: data_block_index_type: 0 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_shortening: 1 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: checksum: 4 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: no_block_cache: 0 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache: 0x55da46f4f090 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_name: BinnedLRUCache 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_options: 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: capacity : 536870912 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: num_shard_bits : 4 2024-05-25T05:39:47.458 INFO:journalctl@ceph.mon.b.smithi136.stdout: strict_capacity_limit : 0 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: high_pri_pool_ratio: 0.000 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_cache_compressed: (nil) 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: persistent_cache: (nil) 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_size: 4096 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_size_deviation: 10 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_restart_interval: 16 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: index_block_restart_interval: 1 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: metadata_block_size: 4096 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: partition_filters: 0 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: use_delta_encoding: 1 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: filter_policy: bloomfilter 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: whole_key_filtering: 1 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: verify_compression: 0 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: read_amp_bytes_per_bit: 0 2024-05-25T05:39:47.459 INFO:journalctl@ceph.mon.b.smithi136.stdout: format_version: 5 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout: enable_index_compression: 1 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout: block_align: 0 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout: max_auto_readahead_size: 262144 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout: prepopulate_block_cache: 0 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout: initial_auto_readahead_size: 8192 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout: num_file_reads_for_auto_readahead: 2 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.write_buffer_size: 33554432 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_write_buffer_number: 2 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression: NoCompression 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression: Disabled 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.prefix_extractor: nullptr 2024-05-25T05:39:47.460 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.num_levels: 7 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:39:47.461 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.level: 32767 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.strategy: 0 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.enabled: false 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.target_file_size_base: 67108864 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-25T05:39:47.462 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.arena_block_size: 1048576 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-25T05:39:47.463 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.disable_auto_compactions: 0 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.table_properties_collectors: 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.inplace_update_support: 0 2024-05-25T05:39:47.464 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.bloom_locality: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.max_successive_merges: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.paranoid_file_checks: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.force_consistency_checks: 1 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.report_bg_io_stats: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.ttl: 2592000 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-25T05:39:47.465 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.enable_blob_files: false 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.min_blob_size: 0 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.blob_file_size: 268435456 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.blob_file_starting_level: 0 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 90.sst 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-b/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 92, last_sequence is 52631, log_number is 88,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 88 2024-05-25T05:39:47.466 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 7d58377b-4925-434a-ac06-39ee339a315a 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615587188061, "job": 1, "event": "recovery_started", "wal_files": [88]} 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #88 mode 2 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615587192665, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 93, "file_size": 569269, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 52626, "largest_seqno": 53143, "table_properties": {"data_size": 566285, "index_size": 1394, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 581, "raw_key_size": 4862, "raw_average_key_size": 23, "raw_value_size": 561668, "raw_average_value_size": 2739, "num_data_blocks": 61, "num_entries": 205, "num_filter_entries": 205, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716615587, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "7d58377b-4925-434a-ac06-39ee339a315a", "db_session_id": "CV4OFM5PJB96OP4PUN3D", "orig_file_number": 93, "seqno_to_time_mapping": "N/A"}} 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615587192775, "job": 1, "event": "recovery_finished"} 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/version_set.cc:5047] Creating manifest 95 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-b/store.db/000088.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55da4703e000 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: DB pointer 0x55da47028000 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** DB Stats ** 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-25T05:39:47.467 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: L0 1/0 555.93 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 222.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: L6 1/0 10.96 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: Sum 2/0 11.50 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 222.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 222.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:39:47.468 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** Compaction Stats [default] ** 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 222.4 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: Cumulative compaction: 0.00 GB write, 73.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:39:47.469 INFO:journalctl@ceph.mon.b.smithi136.stdout: Interval compaction: 0.00 GB write, 73.57 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: Block cache BinnedLRUCache@0x55da46f4f090#2 capacity: 512.00 MB usage: 2.11 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 1e-05 secs_since: 0 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.66 KB,0.00012517%) IndexBlock(1,1.45 KB,0.000277162%) Misc(1,0.00 KB,0%) 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: starting mon.b rank 2 at public addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] at bind addrs [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon_data /var/lib/ceph/mon/ceph-b fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???) e3 preinit fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???).mds e1 new map 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???).mds e1 print_map 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: e1 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: legacy client fscid: -1 2024-05-25T05:39:47.470 INFO:journalctl@ceph.mon.b.smithi136.stdout: 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout: No filesystems configured 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 ceph-mon[113230]: mon.b@-1(???).paxosservice(auth 1..28) refresh upgraded, format 0 -> 3 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 bash[113199]: b80204e525b512e2b17049bc2874218d966056516722122a4e872a1dd693a705 2024-05-25T05:39:47.471 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:47 smithi136 systemd[1]: Started Ceph mon.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: mon.b calling monitor election 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: mon.c calling monitor election 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: mon.a calling monitor election 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: monmap e3: 3 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:39:48.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: fsmap 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: mgrmap e42: y(active, since 4m), standbys: x 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: overall HEALTH_OK 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:48 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: mon.b calling monitor election 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: mon.c calling monitor election 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: mon.a calling monitor election 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: monmap e3: 3 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:39:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: fsmap 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: mgrmap e42: y(active, since 4m), standbys: x 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: pgmap v149: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: mon.b calling monitor election 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: mon.c calling monitor election 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: mon.a calling monitor election 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: monmap e3: 3 mons at {a=[v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0],b=[v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0],c=[v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0]} 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: fsmap 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: mgrmap e42: y(active, since 4m), standbys: x 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: overall HEALTH_OK 2024-05-25T05:39:48.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:48.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:48.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:48.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:48.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:48.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:48.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:48 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.641 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:49 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: pgmap v150: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:49.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:49 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.553 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.553 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.554 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.555 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.556 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.557 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.558 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:50 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:50.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:50 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:51 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: pgmap v151: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:51.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:51.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:51.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:51.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:51 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:39:52 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:39:52.201+0000 7f820dcc1700 -1 mgr.server handle_report got status from non-daemon mon.b 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:52 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:52.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:52 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:53 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:53.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: pgmap v152: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:53.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:53.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:53.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:53.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:53 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:39:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:39:54] "GET /metrics HTTP/1.1" 200 37915 "" "Prometheus/2.43.0" 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:54 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.768 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.769 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.770 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.771 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.772 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:54.773 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.773 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:54.773 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:54.773 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:54.773 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:54.773 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:54 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:55 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.756 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: pgmap v153: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.757 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.758 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.759 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:55.760 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:55 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.803 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.807 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:56 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:56.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:56.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:56 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:57 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: pgmap v154: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:57.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:57.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:57.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:57 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:58 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:58.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:58.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:58.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:58.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:58.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:58 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:39:59 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: pgmap v155: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:39:59.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:39:59.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:39:59 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: overall HEALTH_OK 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:00 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: overall HEALTH_OK 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:00.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:00.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:00.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:00.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:00.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:00 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:01.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:01 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: pgmap v156: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:01.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:01.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:01.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:01 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.776 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.776 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.777 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.778 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.780 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.781 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:02 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:02.820 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:02.821 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:02 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all crash 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all mds 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all crash 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all mds 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all nfs 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all node-exporter 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all prometheus 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all alertmanager 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all grafana 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all loki 2024-05-25T05:40:03.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all promtail 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:40:03.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all nfs 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all node-exporter 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all prometheus 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all alertmanager 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all grafana 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all loki 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all promtail 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Finalizing container_image settings 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:40:03.568 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Finalizing container_image settings 2024-05-25T05:40:03.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.570 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.571 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: Upgrade: Complete! 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.572 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: Upgrade: Complete! 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.573 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.574 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.574 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:03 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.730 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.730 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.730 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: pgmap v157: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.731 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all crash 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all mds 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.732 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]': finished 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all nfs 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.733 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all node-exporter 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all prometheus 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all alertmanager 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all grafana 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all loki 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:03.734 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all promtail 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.b"}]: dispatch 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Finalizing container_image settings 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:40:03.735 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:40:03.736 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: Upgrade: Complete! 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:03.737 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:03.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:03.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:03.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:03 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.477 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:40:04] "GET /metrics HTTP/1.1" 200 37924 "" "Prometheus/2.43.0" 2024-05-25T05:40:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:04 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:04 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:04 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:04 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:04.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:04 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:05.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:05 smithi088 ceph-mon[24736]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:05.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:05 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:05.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:05 smithi088 ceph-mon[29649]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:05.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:05 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:05 smithi136 ceph-mon[113230]: pgmap v158: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:05.877 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:05 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:07.968 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:07 smithi136 ceph-mon[113230]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:08.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:07 smithi088 ceph-mon[24736]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:08.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:07 smithi088 ceph-mon[29649]: pgmap v159: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:09.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:08 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:09.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:08 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:09.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:08 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:10.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:09 smithi136 ceph-mon[113230]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:10.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:09 smithi088 ceph-mon[24736]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:10.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:09 smithi088 ceph-mon[29649]: pgmap v160: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:11 smithi136 ceph-mon[113230]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:12.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:11 smithi088 ceph-mon[29649]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:12.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:11 smithi088 ceph-mon[24736]: pgmap v161: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:13.468 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:40:14.046 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:13 smithi088 ceph-mon[29649]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:14.046 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:13 smithi088 ceph-mon[29649]: from='client.25723 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:14.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:13 smithi088 ceph-mon[24736]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:14.046 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:13 smithi088 ceph-mon[24736]: from='client.25723 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:14.307 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:40:14] "GET /metrics HTTP/1.1" 200 37924 "" "Prometheus/2.43.0" 2024-05-25T05:40:14.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:13 smithi136 ceph-mon[113230]: pgmap v162: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:14.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:13 smithi136 ceph-mon[113230]: from='client.25723 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:15.091 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:14 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:15.091 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:14 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:15.286 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:14 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 16s ago 31m - - 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 12s ago 31m - - 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (2m) 16s ago 26m 15.7M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (82s) 12s ago 26m 80.2M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (4m) 16s ago 25m 57.0M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (4m) 12s ago 30m 454M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (15m) 16s ago 32m 531M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (32m) 16s ago 32m 102M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (28s) 12s ago 31m 33.4M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:40:15.604 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (31m) 16s ago 31m 73.7M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (3m) 16s ago 27m 7894k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (3m) 12s ago 27m 14.8M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (30m) 16s ago 30m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (30m) 16s ago 30m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (29m) 16s ago 29m 50.6M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (29m) 16s ago 29m 56.4M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (29m) 12s ago 29m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (28m) 12s ago 28m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (28m) 12s ago 28m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (27m) 12s ago 27m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (2m) 12s ago 27m 67.6M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (25m) 16s ago 25m 77.9M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:40:15.605 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (25m) 12s ago 25m 79.3M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:40:16.302 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:15 smithi136 ceph-mon[113230]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:16.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:15 smithi088 ceph-mon[24736]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:16.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:15 smithi088 ceph-mon[29649]: pgmap v163: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:16.425 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 2'"'"'' 2024-05-25T05:40:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:16 smithi088 ceph-mon[24736]: from='client.15837 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:17.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:16 smithi088 ceph-mon[29649]: from='client.15837 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:17.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:16 smithi136 ceph-mon[113230]: from='client.15837 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:18.003 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:17 smithi088 ceph-mon[29649]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:18.003 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:17 smithi088 ceph-mon[24736]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:18.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:17 smithi136 ceph-mon[113230]: pgmap v164: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:18.511 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:40:19.105 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:18 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:19.105 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:18 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/1850357046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:19.105 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:18 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:19.105 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:18 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/1850357046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:19.129 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade status' 2024-05-25T05:40:19.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:18 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:19.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:18 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/1850357046' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[24736]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[29649]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:19 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:19 smithi136 ceph-mon[113230]: pgmap v165: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:19 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:19 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:19 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:21.192 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:40:21.192 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": null, 2024-05-25T05:40:21.192 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": false, 2024-05-25T05:40:21.192 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "", 2024-05-25T05:40:21.192 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:40:21.192 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": null, 2024-05-25T05:40:21.193 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-05-25T05:40:21.193 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:40:21.193 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:40:21.976 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:21 smithi088 ceph-mon[24736]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:21.977 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:21 smithi088 ceph-mon[29649]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:22.001 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph health detail' 2024-05-25T05:40:22.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:21 smithi136 ceph-mon[113230]: pgmap v166: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:23.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:22 smithi088 ceph-mon[24736]: from='client.15849 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:23.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:22 smithi088 ceph-mon[29649]: from='client.15849 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:22 smithi136 ceph-mon[113230]: from='client.15849 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:23 smithi136 ceph-mon[113230]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:23 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:23 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:23 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[29649]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:24.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[24736]: pgmap v167: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.283 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:23 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:24.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:40:24] "GET /metrics HTTP/1.1" 200 37922 "" "Prometheus/2.43.0" 2024-05-25T05:40:25.348 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2024-05-25T05:40:26.122 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:25 smithi088 ceph-mon[29649]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:26.122 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:25 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2545418945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:40:26.122 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:25 smithi088 ceph-mon[24736]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:26.122 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:25 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/2545418945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:40:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:25 smithi136 ceph-mon[113230]: pgmap v168: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:26.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:25 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/2545418945' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:40:26.244 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types mon --hosts $(ceph orch ps | grep mgr.y | awk '"'"'{print $2}'"'"')' 2024-05-25T05:40:28.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:27 smithi088 ceph-mon[29649]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:28.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:27 smithi088 ceph-mon[24736]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:28.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:27 smithi136 ceph-mon[113230]: pgmap v169: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:28 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:29.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:28 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:29.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:28 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:29 smithi088 ceph-mon[29649]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:29 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:29 smithi088 ceph-mon[24736]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:29 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:29 smithi136 ceph-mon[113230]: pgmap v170: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:30.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:29 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:31.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:30 smithi088 ceph-mon[29649]: from='client.15861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:31.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:30 smithi088 ceph-mon[29649]: from='client.15867 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mon", "hosts": "smithi088", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:31.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:30 smithi088 ceph-mon[24736]: from='client.15861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:31.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:30 smithi088 ceph-mon[24736]: from='client.15867 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mon", "hosts": "smithi088", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:31.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:30 smithi136 ceph-mon[113230]: from='client.15861 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:30 smithi136 ceph-mon[113230]: from='client.15867 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "mon", "hosts": "smithi088", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:31.635 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:40:32.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[29649]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:32.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:32.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:32.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:32.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:32.290 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:32.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[24736]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:32.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:32.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:32.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:32.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:32.291 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:31 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:32.317 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-05-25T05:40:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:31 smithi136 ceph-mon[113230]: pgmap v171: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:31 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:31 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:31 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:31 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:31 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:33.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:32 smithi088 ceph-mon[24736]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:40:33.212 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:32 smithi088 ceph-mon[24736]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:40:33.212 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:32 smithi088 ceph-mon[29649]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:40:33.212 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:32 smithi088 ceph-mon[29649]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:40:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:32 smithi136 ceph-mon[113230]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:40:33.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:32 smithi136 ceph-mon[113230]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:40:34.282 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:33 smithi088 ceph-mon[29649]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:34.282 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:33 smithi088 ceph-mon[24736]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:34.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:33 smithi136 ceph-mon[113230]: pgmap v172: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:40:34] "GET /metrics HTTP/1.1" 200 37913 "" "Prometheus/2.43.0" 2024-05-25T05:40:35.775 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:40:36.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[29649]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:36.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:36.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:36.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[24736]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:40:36.031 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:35 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-25T05:40:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:35 smithi136 ceph-mon[113230]: pgmap v173: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:35 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:35 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:35 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:35 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:35 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:40:36.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:35 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-25T05:40:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:40:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 17s ago 32m - - 2024-05-25T05:40:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 12s ago 31m - - 2024-05-25T05:40:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (2m) 17s ago 26m 16.0M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:40:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (103s) 12s ago 26m 80.3M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:40:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (5m) 17s ago 25m 57.0M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:40:36.468 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (4m) 12s ago 31m 454M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (15m) 17s ago 32m 532M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (32m) 17s ago 33m 104M 2048M 17.2.0 e1d6a67b021e 8b3757c39634 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (49s) 12s ago 31m 35.7M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (31m) 17s ago 31m 75.8M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (4m) 17s ago 27m 8262k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (3m) 12s ago 27m 15.2M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (31m) 17s ago 30m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (30m) 17s ago 30m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (30m) 17s ago 30m 50.6M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (29m) 17s ago 29m 56.4M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (29m) 12s ago 29m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (29m) 12s ago 29m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:40:36.469 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (28m) 12s ago 28m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:40:36.470 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (28m) 12s ago 28m 55.2M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:40:36.470 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (3m) 12s ago 27m 69.7M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:40:36.470 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (25m) 17s ago 25m 77.9M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:40:36.470 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (25m) 12s ago 25m 79.4M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2, 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 1 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:40:36.873 INFO:teuthology.orchestra.run.smithi088.stdout: "mds": {}, 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 12, 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 3 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:40:36.874 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:40:37.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: Upgrade: Setting container_image for all mgr 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: Upgrade: It appears safe to stop mon.a 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: from='client.25765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:37.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[24736]: from='client.? 172.21.15.88:0/3900852525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: Upgrade: Setting container_image for all mgr 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: Upgrade: It appears safe to stop mon.a 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: from='client.25765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:37.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:36 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/3900852525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi088", 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/2 daemons upgraded", 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:40:37.228 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:40:37.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all mgr 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: Upgrade: It appears safe to stop mon.a 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: from='client.25765 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:37.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:36 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/3900852525' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:38.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[24736]: from='client.15879 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[24736]: from='client.15885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[24736]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[24736]: Upgrade: Updating mon.a 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[24736]: Deploying daemon mon.a on smithi088 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[29649]: from='client.15879 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[29649]: from='client.15885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[29649]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[29649]: Upgrade: Updating mon.a 2024-05-25T05:40:38.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:37 smithi088 ceph-mon[29649]: Deploying daemon mon.a on smithi088 2024-05-25T05:40:38.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:37 smithi136 ceph-mon[113230]: from='client.15879 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:37 smithi136 ceph-mon[113230]: from='client.15885 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:37 smithi136 ceph-mon[113230]: pgmap v174: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:40:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:37 smithi136 ceph-mon[113230]: Upgrade: Updating mon.a 2024-05-25T05:40:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:37 smithi136 ceph-mon[113230]: Deploying daemon mon.a on smithi088 2024-05-25T05:40:38.976 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:38 smithi088 systemd[1]: Stopping Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:40:39.227 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:38 smithi088 ceph-mon[29649]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:39.227 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:38 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:39.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:38 smithi088 ceph-mon[24736]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:39.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:38 smithi088 ceph-mon[24736]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:39.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[24732]: 2024-05-25T05:40:39.103+0000 7f3c9b85c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:40:39.227 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[24732]: 2024-05-25T05:40:39.103+0000 7f3c9b85c700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-25T05:40:39.228 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:39] ENGINE Bus STOPPING 2024-05-25T05:40:39.228 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:39] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:40:39.228 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:39] ENGINE Bus STOPPED 2024-05-25T05:40:39.228 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:39] ENGINE Bus STARTING 2024-05-25T05:40:39.228 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:39] ENGINE Serving on http://:::9283 2024-05-25T05:40:39.345 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:38 smithi136 ceph-mon[113230]: from='client.15897 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:40:39.345 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:38 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:39.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:39 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:39] ENGINE Bus STARTED 2024-05-25T05:40:39.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:39 smithi088 podman[131794]: 2024-05-25 05:40:39.338757899 +0000 UTC m=+0.355142190 container died 8b3757c39634a35c544ec2b4d6956dc953c8bd86c99cdf506aaff6e57b5b78f6 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, vendor=Red Hat, Inc., vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, distribution-scope=public, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, io.k8s.display-name=CentOS Stream 8) 2024-05-25T05:40:39.965 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:39 smithi088 podman[131794]: 2024-05-25 05:40:39.765096035 +0000 UTC m=+0.781480365 container cleanup 8b3757c39634a35c544ec2b4d6956dc953c8bd86c99cdf506aaff6e57b5b78f6 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, architecture=x86_64, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, ceph=True, vcs-type=git, version=8, RELEASE=HEAD, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc.) 2024-05-25T05:40:39.966 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:39 smithi088 bash[131794]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a 2024-05-25T05:40:40.284 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:39 smithi088 podman[131830]: 2024-05-25 05:40:39.966128714 +0000 UTC m=+0.622408487 container remove 8b3757c39634a35c544ec2b4d6956dc953c8bd86c99cdf506aaff6e57b5b78f6 (image=quay.io/ceph/ceph:v17.2.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, io.openshift.expose-services=, GIT_BRANCH=HEAD, name=centos-stream, GIT_CLEAN=True, release=754, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, io.k8s.display-name=CentOS Stream 8, version=8, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-25T05:40:40.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-25T05:40:40.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 systemd[1]: Stopped Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:40:40.285 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service: Consumed 36.598s CPU time. 2024-05-25T05:40:40.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 systemd[1]: Starting Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:40:40.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 podman[131969]: 2024-05-25 05:40:40.502108349 +0000 UTC m=+0.017399973 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:40:40.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 podman[131969]: 2024-05-25 05:40:40.633759708 +0000 UTC m=+0.149051326 container create d124d1401702e3d3df648237ae09f87e73b94fd051c5ff2d4235202f3c2a31b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, org.label-schema.build-date=20240521, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-25T05:40:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 podman[131969]: 2024-05-25 05:40:40.861386026 +0000 UTC m=+0.376677649 container init d124d1401702e3d3df648237ae09f87e73b94fd051c5ff2d4235202f3c2a31b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, RELEASE=squid-ea0684c, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:40:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 podman[131969]: 2024-05-25 05:40:40.865498073 +0000 UTC m=+0.380789703 container start d124d1401702e3d3df648237ae09f87e73b94fd051c5ff2d4235202f3c2a31b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, ceph=True, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS) 2024-05-25T05:40:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: set uid:gid to 167:167 (ceph:ceph) 2024-05-25T05:40:41.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc), process ceph-mon, pid 2 2024-05-25T05:40:41.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: pidfile_write: ignore empty --pid-file 2024-05-25T05:40:41.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: load: jerasure load: lrc 2024-05-25T05:40:41.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: RocksDB version: 7.9.2 2024-05-25T05:40:41.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Git sha 0 2024-05-25T05:40:41.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Compile date 2024-05-23 20:42:41 2024-05-25T05:40:41.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: DB SUMMARY 2024-05-25T05:40:41.309 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: DB Session ID: LWU8VEDWKSHOQ5WQXFY6 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: CURRENT file: CURRENT 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: IDENTITY file: IDENTITY 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: MANIFEST file: MANIFEST-000015 size: 5659 Bytes 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000102.sst 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000100.log size: 653270 ; 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.error_if_exists: 0 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.create_if_missing: 0 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.paranoid_checks: 1 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-25T05:40:41.310 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-25T05:40:41.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.env: 0x564f5d40bc60 2024-05-25T05:40:41.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.fs: PosixFileSystem 2024-05-25T05:40:41.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.info_log: 0x564f5ee75b20 2024-05-25T05:40:41.311 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_file_opening_threads: 16 2024-05-25T05:40:41.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.statistics: (nil) 2024-05-25T05:40:41.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.use_fsync: 0 2024-05-25T05:40:41.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_log_file_size: 0 2024-05-25T05:40:41.313 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.keep_log_file_num: 1000 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.recycle_log_file_num: 0 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.allow_fallocate: 1 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.allow_mmap_reads: 0 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.allow_mmap_writes: 0 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.use_direct_reads: 0 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.create_missing_column_families: 0 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.db_log_dir: 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.wal_dir: 2024-05-25T05:40:41.314 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.advise_random_on_open: 1 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.db_write_buffer_size: 0 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.write_buffer_manager: 0x564f5ee46820 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-25T05:40:41.315 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.rate_limiter: (nil) 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.wal_recovery_mode: 2 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.enable_thread_tracking: 0 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.enable_pipelined_write: 0 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.unordered_write: 0 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.row_cache: None 2024-05-25T05:40:41.316 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.wal_filter: None 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.allow_ingest_behind: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.two_write_queues: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.manual_wal_flush: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.wal_compression: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.atomic_flush: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.log_readahead_size: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.best_efforts_recovery: 0 2024-05-25T05:40:41.317 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.allow_data_in_errors: 0 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.db_host_id: __hostname__ 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_background_jobs: 2 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_background_compactions: -1 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_subcompactions: 1 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_total_wal_size: 0 2024-05-25T05:40:41.318 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_open_files: -1 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bytes_per_sync: 0 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_readahead_size: 0 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_background_flushes: -1 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Compression algorithms supported: 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kZSTD supported: 0 2024-05-25T05:40:41.319 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kXpressCompression supported: 0 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kLZ4HCCompression supported: 1 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kZlibCompression supported: 1 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kSnappyCompression supported: 1 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kLZ4Compression supported: 1 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: kBZip2Compression supported: 0 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.merge_operator: 2024-05-25T05:40:41.320 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_filter: None 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_filter_factory: None 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.sst_partitioner_factory: None 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x564f5ee75c40) 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_type: 0 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_index_type: 0 2024-05-25T05:40:41.321 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_shortening: 1 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: checksum: 4 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: no_block_cache: 0 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache: 0x564f5ee77090 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_options: 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: capacity : 536870912 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: num_shard_bits : 4 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: strict_capacity_limit : 0 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_compressed: (nil) 2024-05-25T05:40:41.322 INFO:journalctl@ceph.mon.a.smithi088.stdout: persistent_cache: (nil) 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size: 4096 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size_deviation: 10 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_restart_interval: 16 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_block_restart_interval: 1 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: metadata_block_size: 4096 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: partition_filters: 0 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_delta_encoding: 1 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: filter_policy: bloomfilter 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: whole_key_filtering: 1 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: verify_compression: 0 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-05-25T05:40:41.323 INFO:journalctl@ceph.mon.a.smithi088.stdout: format_version: 5 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_index_compression: 1 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_align: 0 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout: max_auto_readahead_size: 262144 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout: prepopulate_block_cache: 0 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout: initial_auto_readahead_size: 8192 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.write_buffer_size: 33554432 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_write_buffer_number: 2 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression: NoCompression 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression: Disabled 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.prefix_extractor: nullptr 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-25T05:40:41.324 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.num_levels: 7 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-25T05:40:41.325 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.level: 32767 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.strategy: 0 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.enabled: false 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-25T05:40:41.326 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.target_file_size_base: 67108864 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-25T05:40:41.327 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.arena_block_size: 1048576 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.disable_auto_compactions: 0 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-25T05:40:41.328 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.table_properties_collectors: 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.inplace_update_support: 0 2024-05-25T05:40:41.329 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.bloom_locality: 0 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.max_successive_merges: 0 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.paranoid_file_checks: 0 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.force_consistency_checks: 1 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.report_bg_io_stats: 0 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.ttl: 2592000 2024-05-25T05:40:41.330 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.enable_blob_files: false 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.min_blob_size: 0 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.blob_file_size: 268435456 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-25T05:40:41.331 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.blob_file_starting_level: 0 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 102.sst 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000015 succeeded,manifest_file_number is 15, next_file_number is 104, last_sequence is 52454, log_number is 100,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 100 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6c07ece8-8f23-499f-9443-2d6e825ddc44 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615640895908, "job": 1, "event": "recovery_started", "wal_files": [100]} 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #100 mode 2 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615640898720, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 105, "file_size": 627329, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 52455, "largest_seqno": 53016, "table_properties": {"data_size": 624142, "index_size": 1533, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 645, "raw_key_size": 5444, "raw_average_key_size": 23, "raw_value_size": 618969, "raw_average_value_size": 2645, "num_data_blocks": 68, "num_entries": 234, "num_filter_entries": 234, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716615640, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6c07ece8-8f23-499f-9443-2d6e825ddc44", "db_session_id": "LWU8VEDWKSHOQ5WQXFY6", "orig_file_number": 105, "seqno_to_time_mapping": "N/A"}} 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615640898804, "job": 1, "event": "recovery_finished"} 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/version_set.cc:5047] Creating manifest 107 2024-05-25T05:40:41.332 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000100.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x564f5ef66000 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: DB pointer 0x564f5ef50000 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** DB Stats ** 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-25T05:40:41.333 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: L0 1/0 612.63 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 352.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: L6 1/0 11.45 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: Sum 2/0 12.05 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 352.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 352.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:40:41.334 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 352.8 0.00 0.00 1 0.002 0 0 0.0 0.0 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: Flush(GB): cumulative 0.001, interval 0.001 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:40:41.335 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative compaction: 0.00 GB write, 118.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval compaction: 0.00 GB write, 118.26 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: Block cache BinnedLRUCache@0x564f5ee77090#2 capacity: 512.00 MB usage: 2.30 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.72 KB,0.000137091%) IndexBlock(1,1.58 KB,0.000301003%) Misc(1,0.00 KB,0%) 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: starting mon.a rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???) e3 preinit fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???).mds e1 new map 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???).mds e1 print_map 2024-05-25T05:40:41.336 INFO:journalctl@ceph.mon.a.smithi088.stdout: e1 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout: legacy client fscid: -1 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout: No filesystems configured 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???).osd e113 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???).osd e113 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 ceph-mon[131988]: mon.a@-1(???).paxosservice(auth 1..30) refresh upgraded, format 0 -> 3 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 bash[131969]: d124d1401702e3d3df648237ae09f87e73b94fd051c5ff2d4235202f3c2a31b9 2024-05-25T05:40:41.337 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:40 smithi088 systemd[1]: Started Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:40:42.634 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: ignoring --setuser ceph since I am not root 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: ignoring --setgroup ceph since I am not root 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mgr[78342]: -- 172.21.15.136:0/2883768736 <== mon.2 v2:172.21.15.136:3300/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55d05b6d65a0 con 0x55d05b6aa800 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:42.512+0000 7f2a194f6200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: mon.a calling monitor election 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: monmap epoch 3 2024-05-25T05:40:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: last_changed 2024-05-25T05:09:01.561311+0000 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: min_mon_release 17 (quincy) 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: election_strategy: 1 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: fsmap 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: mgrmap e42: y(active, since 5m), standbys: x 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: overall HEALTH_OK 2024-05-25T05:40:42.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: from='mgr.15312 ' entity='' 2024-05-25T05:40:42.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: mgrmap e43: y(active, since 5m), standbys: x 2024-05-25T05:40:42.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:42 smithi136 ceph-mon[113230]: from='mgr.15312 ' entity='' 2024-05-25T05:40:42.702 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ignoring --setuser ceph since I am not root 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ignoring --setgroup ceph since I am not root 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mgr[70724]: -- 172.21.15.88:0/749302342 <== mon.1 v2:172.21.15.88:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x557e7028c5a0 con 0x557e70260c00 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:42.517+0000 7f1a3fc02200 -1 mgr[py] Module balancer has missing NOTIFY_TYPES member 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:42.703 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: mon.a calling monitor election 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: monmap epoch 3 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: last_changed 2024-05-25T05:09:01.561311+0000 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: min_mon_release 17 (quincy) 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: election_strategy: 1 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: fsmap 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: mgrmap e42: y(active, since 5m), standbys: x 2024-05-25T05:40:42.704 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: from='mgr.15312 ' entity='' 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: mgrmap e43: y(active, since 5m), standbys: x 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[29649]: from='mgr.15312 ' entity='' 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: from='mgr.15312 172.21.15.88:0/23678215' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: pgmap v176: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: mon.a calling monitor election 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:40:42.705 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: monmap epoch 3 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: last_changed 2024-05-25T05:09:01.561311+0000 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: min_mon_release 17 (quincy) 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: election_strategy: 1 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: fsmap 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: osdmap e113: 8 total, 8 up, 8 in 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: mgrmap e42: y(active, since 5m), standbys: x 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: overall HEALTH_OK 2024-05-25T05:40:42.706 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: from='mgr.15312 ' entity='' 2024-05-25T05:40:42.707 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: mgrmap e43: y(active, since 5m), standbys: x 2024-05-25T05:40:42.707 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:42 smithi088 ceph-mon[131988]: from='mgr.15312 ' entity='' 2024-05-25T05:40:43.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:42.701+0000 7f1a3fc02200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:40:43.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:42 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:42.804+0000 7f1a3fc02200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:40:43.107 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:42.695+0000 7f2a194f6200 -1 mgr[py] Module orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:40:43.108 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:42.798+0000 7f2a194f6200 -1 mgr[py] Module snap_schedule has missing NOTIFY_TYPES member 2024-05-25T05:40:43.108 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:43.107+0000 7f2a194f6200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:40:43.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:43.193+0000 7f2a194f6200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:40:43.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:43.115+0000 7f1a3fc02200 -1 mgr[py] Module progress has missing NOTIFY_TYPES member 2024-05-25T05:40:43.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:43 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:43.199+0000 7f1a3fc02200 -1 mgr[py] Module influx has missing NOTIFY_TYPES member 2024-05-25T05:40:44.409 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:44 smithi088 ceph-mon[29649]: mgrmap e44: y(active, since 5m), standbys: x 2024-05-25T05:40:44.410 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:44 smithi088 ceph-mon[131988]: mgrmap e44: y(active, since 5m), standbys: x 2024-05-25T05:40:44.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:44 smithi136 ceph-mon[113230]: mgrmap e44: y(active, since 5m), standbys: x 2024-05-25T05:40:44.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:44.397+0000 7f2a194f6200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:40:44.635 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:44.570+0000 7f2a194f6200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:40:44.758 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:44.408+0000 7f1a3fc02200 -1 mgr[py] Module telegraf has missing NOTIFY_TYPES member 2024-05-25T05:40:44.758 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:44.582+0000 7f1a3fc02200 -1 mgr[py] Module osd_support has missing NOTIFY_TYPES member 2024-05-25T05:40:45.046 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:44.743+0000 7f2a194f6200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:40:45.046 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:45.045+0000 7f2a194f6200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:40:45.056 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:44.757+0000 7f1a3fc02200 -1 mgr[py] Module iostat has missing NOTIFY_TYPES member 2024-05-25T05:40:45.302 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:45.146+0000 7f2a194f6200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:40:45.368 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:45.057+0000 7f1a3fc02200 -1 mgr[py] Module alerts has missing NOTIFY_TYPES member 2024-05-25T05:40:45.368 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:45.160+0000 7f1a3fc02200 -1 mgr[py] Module selftest has missing NOTIFY_TYPES member 2024-05-25T05:40:45.594 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:45.381+0000 7f2a194f6200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:40:45.620 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:45.367+0000 7f1a3fc02200 -1 mgr[py] Module pg_autoscaler has missing NOTIFY_TYPES member 2024-05-25T05:40:45.620 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:45.574+0000 7f1a3fc02200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:40:45.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:45.593+0000 7f2a194f6200 -1 mgr[py] Module test_orchestrator has missing NOTIFY_TYPES member 2024-05-25T05:40:46.384 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:46.244+0000 7f2a194f6200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:40:46.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:46.238+0000 7f1a3fc02200 -1 mgr[py] Module rook has missing NOTIFY_TYPES member 2024-05-25T05:40:46.997 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:46.686+0000 7f1a3fc02200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:40:46.997 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:46.786+0000 7f1a3fc02200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:40:47.016 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:46.694+0000 7f2a194f6200 -1 mgr[py] Module volumes has missing NOTIFY_TYPES member 2024-05-25T05:40:47.016 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:46.799+0000 7f2a194f6200 -1 mgr[py] Module crash has missing NOTIFY_TYPES member 2024-05-25T05:40:47.016 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:47.016+0000 7f2a194f6200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:40:47.306 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:46 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:46.996+0000 7f1a3fc02200 -1 mgr[py] Module rgw has missing NOTIFY_TYPES member 2024-05-25T05:40:47.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:47.528+0000 7f1a3fc02200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:40:47.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:47.624+0000 7f1a3fc02200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:40:47.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:47.573+0000 7f2a194f6200 -1 mgr[py] Module prometheus has missing NOTIFY_TYPES member 2024-05-25T05:40:47.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:47.669+0000 7f2a194f6200 -1 mgr[py] Module devicehealth has missing NOTIFY_TYPES member 2024-05-25T05:40:48.230 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:47 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:47.873+0000 7f1a3fc02200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:40:48.231 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:48 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:48.011+0000 7f1a3fc02200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:40:48.231 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:48 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:48.109+0000 7f1a3fc02200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:40:48.231 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:48 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:48.230+0000 7f1a3fc02200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:40:48.286 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:47.920+0000 7f2a194f6200 -1 mgr[py] Module telemetry has missing NOTIFY_TYPES member 2024-05-25T05:40:48.286 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:48.059+0000 7f2a194f6200 -1 mgr[py] Module diskprediction_local has missing NOTIFY_TYPES member 2024-05-25T05:40:48.286 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:48.160+0000 7f2a194f6200 -1 mgr[py] Module osd_perf_query has missing NOTIFY_TYPES member 2024-05-25T05:40:48.590 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:48.282+0000 7f2a194f6200 -1 mgr[py] Module rbd_support has missing NOTIFY_TYPES member 2024-05-25T05:40:48.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:48 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:48.534+0000 7f1a3fc02200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:40:48.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:48.590+0000 7f2a194f6200 -1 mgr[py] Module zabbix has missing NOTIFY_TYPES member 2024-05-25T05:40:49.429 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:49.148+0000 7f1a3fc02200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:40:49.429 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:49.374+0000 7f1a3fc02200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:40:49.536 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:49.204+0000 7f2a194f6200 -1 mgr[py] Module status has missing NOTIFY_TYPES member 2024-05-25T05:40:49.536 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:49.433+0000 7f2a194f6200 -1 mgr[py] Module nfs has missing NOTIFY_TYPES member 2024-05-25T05:40:49.536 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: [25/May/2024:05:40:49] ENGINE Bus STARTING 2024-05-25T05:40:49.536 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: Active manager daemon y restarted 2024-05-25T05:40:49.536 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: Activating manager daemon y 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: mgrmap e45: y(active, starting, since 0.00623547s), standbys: x 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:40:49.537 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:40:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:40:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:40:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:40:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:40:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:40:49.538 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:49 smithi136 ceph-mon[113230]: Manager daemon y is now available 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:49] ENGINE Bus STARTING 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: CherryPy Checker: 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: The Application mounted at '' has an empty config. 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:49] ENGINE Serving on http://:::9283 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:49 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:40:49] ENGINE Bus STARTED 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: Active manager daemon y restarted 2024-05-25T05:40:49.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: Activating manager daemon y 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: mgrmap e45: y(active, starting, since 0.00623547s), standbys: x 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:40:49.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[29649]: Manager daemon y is now available 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: Active manager daemon y restarted 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: Activating manager daemon y 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: mgrmap e45: y(active, starting, since 0.00623547s), standbys: x 2024-05-25T05:40:49.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "y", "id": "y"}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr metadata", "who": "x", "id": "x"}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 1}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 2}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 3}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 4}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 5}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 6}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 7}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mds metadata"}]: dispatch 2024-05-25T05:40:49.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata"}]: dispatch 2024-05-25T05:40:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata"}]: dispatch 2024-05-25T05:40:49.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:49 smithi088 ceph-mon[131988]: Manager daemon y is now available 2024-05-25T05:40:49.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: CherryPy Checker: 2024-05-25T05:40:49.884 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: The Application mounted at '' has an empty config. 2024-05-25T05:40:49.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: 2024-05-25T05:40:49.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: [25/May/2024:05:40:49] ENGINE Serving on http://:::9283 2024-05-25T05:40:49.885 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:40:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x[78338]: [25/May/2024:05:40:49] ENGINE Bus STARTED 2024-05-25T05:40:50.806 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:40:50.387+0000 7f19fd064700 -1 mgr.server handle_report got status from non-daemon mon.a 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Standby manager daemon x restarted 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Standby manager daemon x started 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: [25/May/2024:05:40:49] ENGINE Bus STARTING 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: [25/May/2024:05:40:49] ENGINE Serving on https://172.21.15.88:7151 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: [25/May/2024:05:40:49] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:40:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: [25/May/2024:05:40:49] ENGINE Bus STARTED 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Standby manager daemon x restarted 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Standby manager daemon x started 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:50.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:40:50.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: [25/May/2024:05:40:49] ENGINE Bus STARTING 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: [25/May/2024:05:40:49] ENGINE Serving on https://172.21.15.88:7151 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: [25/May/2024:05:40:49] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: [25/May/2024:05:40:49] ENGINE Bus STARTED 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: mgrmap e46: y(active, since 1.01065s), standbys: x 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:50.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:40:50.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: mgrmap e46: y(active, since 1.01065s), standbys: x 2024-05-25T05:40:50.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:50 smithi088 ceph-mon[131988]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Standby manager daemon x restarted 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Standby manager daemon x started 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/crt"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/crt"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/x/key"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.? 172.21.15.136:0/3365458824' entity='mgr.x' cmd=[{"prefix": "config-key get", "key": "mgr/dashboard/key"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi088", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "config rm", "who": "osd/host:smithi136", "name": "osd_memory_target"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Updating smithi088:/etc/ceph/ceph.conf 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Updating smithi136:/etc/ceph/ceph.conf 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/mirror_snapshot_schedule"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix":"config rm","who":"mgr","name":"mgr/rbd_support/y/trash_purge_schedule"}]: dispatch 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: [25/May/2024:05:40:49] ENGINE Bus STARTING 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: [25/May/2024:05:40:49] ENGINE Serving on https://172.21.15.88:7151 2024-05-25T05:40:50.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: [25/May/2024:05:40:49] ENGINE Serving on http://172.21.15.88:8765 2024-05-25T05:40:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: [25/May/2024:05:40:49] ENGINE Bus STARTED 2024-05-25T05:40:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:40:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.conf 2024-05-25T05:40:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Updating smithi088:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:40:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: Updating smithi136:/etc/ceph/ceph.client.admin.keyring 2024-05-25T05:40:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: mgrmap e46: y(active, since 1.01065s), standbys: x 2024-05-25T05:40:50.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:50 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.804 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:51.805 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:51.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:51.806 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:51 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: pgmap v3: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: Updating smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: Updating smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/config/ceph.client.admin.keyring 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi088", "caps": []}]: dispatch 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: pgmap v4: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.agent.smithi136", "caps": []}]: dispatch 2024-05-25T05:40:52.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:51 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: mgrmap e47: y(active, since 2s), standbys: x 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: mgrmap e47: y(active, since 2s), standbys: x 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:52.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:52 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.026 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: mgrmap e47: y(active, since 2s), standbys: x 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.027 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.028 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.029 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.030 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:52 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.925 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.926 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.927 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.928 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.929 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.930 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.931 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.931 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.932 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.933 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.934 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.935 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:53 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.973 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.974 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.975 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.975 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.975 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.975 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.975 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.975 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.976 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.977 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: pgmap v5: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.978 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.979 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.979 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.979 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.979 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:53.979 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:53.979 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:53.979 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:53.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:53.980 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:53 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.550 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:40:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:40:54] "GET /metrics HTTP/1.1" 200 35126 "" "Prometheus/2.43.0" 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: mgrmap e48: y(active, since 4s), standbys: x 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: mgrmap e48: y(active, since 4s), standbys: x 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:54.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:54 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.108 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.109 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: mgrmap e48: y(active, since 4s), standbys: x 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.110 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.111 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.112 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:54 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: Upgrade: It appears safe to stop mon.a 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[131988]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: Upgrade: It appears safe to stop mon.a 2024-05-25T05:40:55.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:55 smithi088 ceph-mon[29649]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:56.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:40:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:40:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:40:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["a"]}]: dispatch 2024-05-25T05:40:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: Upgrade: It appears safe to stop mon.a 2024-05-25T05:40:56.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:55 smithi136 ceph-mon[113230]: pgmap v6: 161 pgs: 161 active+clean; 585 KiB data, 99 MiB used, 715 GiB / 715 GiB avail; 1 KiB/s rd, 1 op/s 2024-05-25T05:40:57.620 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:57 smithi136 ceph-mon[113230]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:40:57.670 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:57 smithi088 ceph-mon[29649]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:40:57.670 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:57 smithi088 ceph-mon[131988]: pgmap v7: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 30 KiB/s rd, 0 B/s wr, 17 op/s 2024-05-25T05:40:58.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: Upgrade: Updating mon.a 2024-05-25T05:40:58.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:40:58.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:40:58.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:58.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: Deploying daemon mon.a on smithi088 2024-05-25T05:40:58.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.600 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: Upgrade: Updating mon.a 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: Deploying daemon mon.a on smithi088 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.601 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:58 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: Upgrade: Updating mon.a 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: Deploying daemon mon.a on smithi088 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:58 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:59 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:59 smithi088 ceph-mon[131988]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:59.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:40:59 smithi088 ceph-mon[131988]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:40:59.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:59 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:59.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:59 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:59.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:40:59 smithi088 ceph-mon[29649]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:40:59.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:59 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:59 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:40:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:40:59 smithi136 ceph-mon[113230]: pgmap v8: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 23 KiB/s rd, 0 B/s wr, 13 op/s 2024-05-25T05:41:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:00 smithi088 systemd[1]: Stopping Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:41:01.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:01 smithi088 ceph-mon[131988]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:01.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:01 smithi088 ceph-mon[131988]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:41:01.745 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:01 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:01.745 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:01 smithi088 ceph-mon[29649]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:41:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:01 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:01.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:01 smithi136 ceph-mon[113230]: pgmap v9: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 20 KiB/s rd, 0 B/s wr, 11 op/s 2024-05-25T05:41:02.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[131984]: 2024-05-25T05:41:02.324+0000 7f10db623700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:41:02.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[131984]: 2024-05-25T05:41:02.324+0000 7f10db623700 -1 mon.a@0(leader) e3 *** Got Signal Terminated *** 2024-05-25T05:41:02.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:02 smithi088 podman[135106]: 2024-05-25 05:41:02.345626098 +0000 UTC m=+0.120776069 container died d124d1401702e3d3df648237ae09f87e73b94fd051c5ff2d4235202f3c2a31b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-25T05:41:02.933 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:02 smithi088 podman[135106]: 2024-05-25 05:41:02.749633038 +0000 UTC m=+0.524783002 container cleanup d124d1401702e3d3df648237ae09f87e73b94fd051c5ff2d4235202f3c2a31b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS) 2024-05-25T05:41:02.934 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:02 smithi088 bash[135106]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a 2024-05-25T05:41:03.924 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:03 smithi088 podman[135139]: 2024-05-25 05:41:03.604069187 +0000 UTC m=+1.252299359 container remove d124d1401702e3d3df648237ae09f87e73b94fd051c5ff2d4235202f3c2a31b9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, ceph=True, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ea0684c, org.label-schema.license=GPLv2) 2024-05-25T05:41:04.548 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:41:04] "GET /metrics HTTP/1.1" 200 35126 "" "Prometheus/2.43.0" 2024-05-25T05:41:04.549 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service: Deactivated successfully. 2024-05-25T05:41:04.549 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 systemd[1]: Stopped Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:41:04.549 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service: Consumed 1.567s CPU time. 2024-05-25T05:41:04.549 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 systemd[1]: Starting Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:41:04.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 podman[135440]: 2024-05-25 05:41:04.73325648 +0000 UTC m=+0.107654135 container create a339af319c03fa9b03749f7d071db6cb6c6db6d9d08d447f7b98d1ef8baaea1c (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True) 2024-05-25T05:41:04.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 podman[135440]: 2024-05-25 05:41:04.646127985 +0000 UTC m=+0.020525632 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:41:05.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 podman[135440]: 2024-05-25 05:41:04.960688193 +0000 UTC m=+0.335085827 container init a339af319c03fa9b03749f7d071db6cb6c6db6d9d08d447f7b98d1ef8baaea1c (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, ceph=True, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, RELEASE=squid-ea0684c) 2024-05-25T05:41:05.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 podman[135440]: 2024-05-25 05:41:04.96446504 +0000 UTC m=+0.338862683 container start a339af319c03fa9b03749f7d071db6cb6c6db6d9d08d447f7b98d1ef8baaea1c (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, GIT_CLEAN=True, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-ea0684c, ceph=True) 2024-05-25T05:41:05.232 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: set uid:gid to 167:167 (ceph:ceph) 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc), process ceph-mon, pid 2 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: pidfile_write: ignore empty --pid-file 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: load: jerasure load: lrc 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: RocksDB version: 7.9.2 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Git sha 0 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Compile date 2024-05-23 20:42:41 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: DB SUMMARY 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: DB Session ID: AJ4JFOLVHYKSHHVSP39N 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: CURRENT file: CURRENT 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: IDENTITY file: IDENTITY 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: MANIFEST file: MANIFEST-000107 size: 509 Bytes 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: SST files in /var/lib/ceph/mon/ceph-a/store.db dir, Total Num: 1, files: 000112.sst 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-a/store.db: 000110.log size: 1881319 ; 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.error_if_exists: 0 2024-05-25T05:41:05.233 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.create_if_missing: 0 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.paranoid_checks: 1 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.env: 0x562e17e14c60 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.fs: PosixFileSystem 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.info_log: 0x562e1a689b20 2024-05-25T05:41:05.234 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_file_opening_threads: 16 2024-05-25T05:41:05.235 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.statistics: (nil) 2024-05-25T05:41:05.235 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.use_fsync: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_log_file_size: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.keep_log_file_num: 1000 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.recycle_log_file_num: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.allow_fallocate: 1 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.allow_mmap_reads: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.allow_mmap_writes: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.use_direct_reads: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.create_missing_column_families: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.db_log_dir: 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.wal_dir: 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-25T05:41:05.236 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.advise_random_on_open: 1 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.db_write_buffer_size: 0 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.write_buffer_manager: 0x562e1a65a820 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.rate_limiter: (nil) 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.wal_recovery_mode: 2 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.enable_thread_tracking: 0 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.enable_pipelined_write: 0 2024-05-25T05:41:05.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.unordered_write: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.row_cache: None 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.wal_filter: None 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.allow_ingest_behind: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.two_write_queues: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.manual_wal_flush: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.wal_compression: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.atomic_flush: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-25T05:41:05.238 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.log_readahead_size: 0 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.best_efforts_recovery: 0 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.allow_data_in_errors: 0 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.db_host_id: __hostname__ 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_background_jobs: 2 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_background_compactions: -1 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_subcompactions: 1 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-25T05:41:05.239 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_total_wal_size: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_open_files: -1 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bytes_per_sync: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_readahead_size: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_background_flushes: -1 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Compression algorithms supported: 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kZSTD supported: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kXpressCompression supported: 0 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kLZ4HCCompression supported: 1 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kZlibCompression supported: 1 2024-05-25T05:41:05.240 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kSnappyCompression supported: 1 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kLZ4Compression supported: 1 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: kBZip2Compression supported: 0 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000107 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.merge_operator: 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_filter: None 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_filter_factory: None 2024-05-25T05:41:05.241 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.sst_partitioner_factory: None 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x562e1a689c40) 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_type: 0 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_index_type: 0 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_shortening: 1 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: checksum: 4 2024-05-25T05:41:05.242 INFO:journalctl@ceph.mon.a.smithi088.stdout: no_block_cache: 0 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache: 0x562e1a68b090 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_options: 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: capacity : 536870912 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: num_shard_bits : 4 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: strict_capacity_limit : 0 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_cache_compressed: (nil) 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: persistent_cache: (nil) 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size: 4096 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_size_deviation: 10 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_restart_interval: 16 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: index_block_restart_interval: 1 2024-05-25T05:41:05.243 INFO:journalctl@ceph.mon.a.smithi088.stdout: metadata_block_size: 4096 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: partition_filters: 0 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: use_delta_encoding: 1 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: filter_policy: bloomfilter 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: whole_key_filtering: 1 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: verify_compression: 0 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: format_version: 5 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_index_compression: 1 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: block_align: 0 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: max_auto_readahead_size: 262144 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: prepopulate_block_cache: 0 2024-05-25T05:41:05.244 INFO:journalctl@ceph.mon.a.smithi088.stdout: initial_auto_readahead_size: 8192 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.write_buffer_size: 33554432 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_write_buffer_number: 2 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression: NoCompression 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression: Disabled 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.prefix_extractor: nullptr 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.num_levels: 7 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-25T05:41:05.245 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-25T05:41:05.246 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.level: 32767 2024-05-25T05:41:05.247 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.strategy: 0 2024-05-25T05:41:05.247 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-25T05:41:05.247 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:41:05.247 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:41:05.247 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-25T05:41:05.247 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.enabled: false 2024-05-25T05:41:05.247 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:41:05.248 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-25T05:41:05.248 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-25T05:41:05.248 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-25T05:41:05.248 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.target_file_size_base: 67108864 2024-05-25T05:41:05.248 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-25T05:41:05.248 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-25T05:41:05.249 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-25T05:41:05.249 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-25T05:41:05.249 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-25T05:41:05.249 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-25T05:41:05.249 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-25T05:41:05.249 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-25T05:41:05.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-25T05:41:05.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-25T05:41:05.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-25T05:41:05.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-25T05:41:05.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-25T05:41:05.250 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-25T05:41:05.251 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.arena_block_size: 1048576 2024-05-25T05:41:05.251 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-25T05:41:05.251 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-25T05:41:05.251 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.disable_auto_compactions: 0 2024-05-25T05:41:05.251 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-25T05:41:05.251 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-25T05:41:05.252 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-25T05:41:05.252 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-25T05:41:05.252 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-25T05:41:05.252 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-25T05:41:05.252 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-25T05:41:05.252 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-25T05:41:05.252 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-25T05:41:05.253 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-25T05:41:05.253 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.table_properties_collectors: 2024-05-25T05:41:05.253 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.inplace_update_support: 0 2024-05-25T05:41:05.253 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-25T05:41:05.253 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-25T05:41:05.253 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-25T05:41:05.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-25T05:41:05.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.bloom_locality: 0 2024-05-25T05:41:05.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.max_successive_merges: 0 2024-05-25T05:41:05.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-25T05:41:05.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.paranoid_file_checks: 0 2024-05-25T05:41:05.254 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.force_consistency_checks: 1 2024-05-25T05:41:05.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.report_bg_io_stats: 0 2024-05-25T05:41:05.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.ttl: 2592000 2024-05-25T05:41:05.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-25T05:41:05.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-25T05:41:05.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-25T05:41:05.255 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.enable_blob_files: false 2024-05-25T05:41:05.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.min_blob_size: 0 2024-05-25T05:41:05.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.blob_file_size: 268435456 2024-05-25T05:41:05.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-25T05:41:05.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-25T05:41:05.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-25T05:41:05.256 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-25T05:41:05.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-25T05:41:05.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.blob_file_starting_level: 0 2024-05-25T05:41:05.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-25T05:41:05.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:41:05.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-a/store.db/MANIFEST-000107 succeeded,manifest_file_number is 107, next_file_number is 114, last_sequence is 53496, log_number is 110,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 110 2024-05-25T05:41:05.257 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 110 2024-05-25T05:41:05.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: 6c07ece8-8f23-499f-9443-2d6e825ddc44 2024-05-25T05:41:05.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615664994999, "job": 1, "event": "recovery_started", "wal_files": [110]} 2024-05-25T05:41:05.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:04 smithi088 ceph-mon[135492]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #110 mode 2 2024-05-25T05:41:05.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615665000654, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 115, "file_size": 1775916, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 53498, "largest_seqno": 54305, "table_properties": {"data_size": 1771387, "index_size": 2363, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 1157, "raw_key_size": 10901, "raw_average_key_size": 24, "raw_value_size": 1762511, "raw_average_value_size": 3908, "num_data_blocks": 104, "num_entries": 451, "num_filter_entries": 451, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716615664, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "6c07ece8-8f23-499f-9443-2d6e825ddc44", "db_session_id": "AJ4JFOLVHYKSHHVSP39N", "orig_file_number": 115, "seqno_to_time_mapping": "N/A"}} 2024-05-25T05:41:05.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615665000763, "job": 1, "event": "recovery_finished"} 2024-05-25T05:41:05.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: [db/version_set.cc:5047] Creating manifest 117 2024-05-25T05:41:05.259 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:41:05.259 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-a/store.db/000110.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-25T05:41:05.259 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x562e1a77a000 2024-05-25T05:41:05.259 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: DB pointer 0x562e1a764000 2024-05-25T05:41:05.259 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-25T05:41:05.260 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-25T05:41:05.260 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** DB Stats ** 2024-05-25T05:41:05.260 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:41:05.260 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-25T05:41:05.260 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:41:05.260 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:41:05.260 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-25T05:41:05.261 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:41:05.261 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:41:05.261 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:41:05.261 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:41:05.261 INFO:journalctl@ceph.mon.a.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:41:05.261 INFO:journalctl@ceph.mon.a.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-25T05:41:05.262 INFO:journalctl@ceph.mon.a.smithi088.stdout: L0 1/0 1.69 MB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 575.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-25T05:41:05.262 INFO:journalctl@ceph.mon.a.smithi088.stdout: L6 1/0 12.43 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-25T05:41:05.262 INFO:journalctl@ceph.mon.a.smithi088.stdout: Sum 2/0 14.12 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 575.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-25T05:41:05.262 INFO:journalctl@ceph.mon.a.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 575.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-25T05:41:05.262 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:41:05.262 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:41:05.263 INFO:journalctl@ceph.mon.a.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:41:05.263 INFO:journalctl@ceph.mon.a.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:41:05.263 INFO:journalctl@ceph.mon.a.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 575.1 0.00 0.00 1 0.003 0 0 0.0 0.0 2024-05-25T05:41:05.263 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:41:05.263 INFO:journalctl@ceph.mon.a.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-25T05:41:05.263 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:41:05.263 INFO:journalctl@ceph.mon.a.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:41:05.264 INFO:journalctl@ceph.mon.a.smithi088.stdout: Flush(GB): cumulative 0.002, interval 0.002 2024-05-25T05:41:05.264 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:41:05.264 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:41:05.264 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:41:05.264 INFO:journalctl@ceph.mon.a.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:41:05.264 INFO:journalctl@ceph.mon.a.smithi088.stdout: Cumulative compaction: 0.00 GB write, 212.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout: Interval compaction: 0.00 GB write, 212.48 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout: Block cache BinnedLRUCache@0x562e1a68b090#2 capacity: 512.00 MB usage: 3.86 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,1.28 KB,0.000244379%) IndexBlock(1,2.58 KB,0.000491738%) Misc(1,0.00 KB,0%) 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: starting mon.a rank 0 at public addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] at bind addrs [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon_data /var/lib/ceph/mon/ceph-a fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:05.265 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???) e3 preinit fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???).mds e1 new map 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???).mds e1 print_map 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout: e1 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout: legacy client fscid: -1 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout: 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout: No filesystems configured 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???).osd e114 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:41:05.266 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:41:05.267 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:41:05.267 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 ceph-mon[135492]: mon.a@-1(???).paxosservice(auth 1..31) refresh upgraded, format 0 -> 3 2024-05-25T05:41:05.267 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 bash[135440]: a339af319c03fa9b03749f7d071db6cb6c6db6d9d08d447f7b98d1ef8baaea1c 2024-05-25T05:41:05.267 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:05 smithi088 systemd[1]: Started Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: mon.a calling monitor election 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: monmap epoch 3 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: last_changed 2024-05-25T05:09:01.561311+0000 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:41:06.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: min_mon_release 17 (quincy) 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: election_strategy: 1 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: fsmap 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: mgrmap e48: y(active, since 17s), standbys: x 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: overall HEALTH_OK 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='' 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='' 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:06.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: mon.a calling monitor election 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: monmap epoch 3 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: last_changed 2024-05-25T05:09:01.561311+0000 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: min_mon_release 17 (quincy) 2024-05-25T05:41:06.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: election_strategy: 1 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: fsmap 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: mgrmap e48: y(active, since 17s), standbys: x 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: overall HEALTH_OK 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='' 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='' 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:06.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:06 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: pgmap v10: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: pgmap v11: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: mon.a calling monitor election 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: monmap epoch 3 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: last_changed 2024-05-25T05:09:01.561311+0000 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: min_mon_release 17 (quincy) 2024-05-25T05:41:06.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: election_strategy: 1 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: fsmap 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: mgrmap e48: y(active, since 17s), standbys: x 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: overall HEALTH_OK 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='' 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='' 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:06.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:06.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:06 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.631 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.632 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.633 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.634 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.634 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:41:07.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.634 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.635 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.636 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.637 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[29649]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.638 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:07 smithi088 ceph-mon[135492]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:07.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:07.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:07 smithi136 ceph-mon[113230]: pgmap v12: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 18 KiB/s rd, 0 B/s wr, 10 op/s 2024-05-25T05:41:08.349 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:41:08.349 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 9s ago 32m - - 2024-05-25T05:41:08.349 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 10s ago 32m - - 2024-05-25T05:41:08.349 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (3m) 9s ago 27m 16.0M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:41:08.349 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (2m) 10s ago 26m 81.4M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (5m) 9s ago 26m 57.0M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (5m) 10s ago 31m 449M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (16m) 9s ago 33m 533M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 starting - - - 2048M 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (81s) 10s ago 32m 40.4M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (32m) 9s ago 32m 76.3M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (4m) 9s ago 27m 7486k - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (4m) 10s ago 27m 14.7M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (31m) 9s ago 31m 54.7M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (31m) 9s ago 31m 56.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (30m) 9s ago 30m 50.7M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (30m) 9s ago 30m 56.4M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:41:08.350 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (29m) 10s ago 29m 57.0M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:41:08.351 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (29m) 10s ago 29m 52.2M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:41:08.351 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (29m) 10s ago 29m 54.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:41:08.351 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (28m) 10s ago 28m 55.8M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:41:08.351 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (3m) 10s ago 28m 69.8M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:41:08.351 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (26m) 9s ago 26m 78.0M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:41:08.351 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (26m) 10s ago 26m 79.6M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:41:08.801 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:41:08.855 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:41:08.855 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 1, 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 11, 2024-05-25T05:41:08.856 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 4 2024-05-25T05:41:08.857 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:41:08.857 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:41:08.857 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.857 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.857 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.857 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.857 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='client.25831 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.858 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.859 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='client.25831 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.860 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.861 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='client.54108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.863 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='client.25843 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='client.54108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='client.25843 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.866 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:08 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='client.25831 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='client.54108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='client.25843 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:08.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:08 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi088", 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/2 daemons upgraded", 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:41:09.171 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:41:09.639 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.640 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/2678393631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.641 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='client.25855 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.642 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.643 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='client.? 172.21.15.88:0/2678393631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.645 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='client.25855 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.646 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.647 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.648 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:09 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/2678393631' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='client.25855 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: pgmap v13: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:09.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:09.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:09 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.804 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.804 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.805 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:10 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:10.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:10.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:10 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.771 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:11.771 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.771 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.771 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.771 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.771 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.771 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.772 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.773 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.774 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.775 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.776 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:11.777 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.778 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.778 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.778 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.778 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.778 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.779 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.779 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.779 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.779 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.779 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.780 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.781 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:11 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: pgmap v14: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:11.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:11.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:11 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.811 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:12 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:12.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:12 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:13 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: pgmap v15: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:13.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:13 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:41:14] "GET /metrics HTTP/1.1" 200 37934 "" "Prometheus/2.43.0" 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.560 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.561 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.564 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:14 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:14.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:14 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[135492]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.817 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:15 smithi088 ceph-mon[29649]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:15.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:15.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:15 smithi136 ceph-mon[113230]: pgmap v16: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.661 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.662 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.663 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.664 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.665 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.665 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.665 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.665 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.665 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.665 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.665 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.666 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.666 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.666 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.666 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.666 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.666 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.666 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:16 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.813 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:16.819 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:16 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.734 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.735 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.736 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.737 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.738 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.741 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.742 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:17 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.863 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.864 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.865 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.866 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: pgmap v17: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:17.867 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:17 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: Upgrade: It appears safe to stop mon.c 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: Upgrade: It appears safe to stop mon.c 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:18 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "quorum_status"}]: dispatch 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon ok-to-stop", "ids": ["c"]}]: dispatch 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: Upgrade: It appears safe to stop mon.c 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:18.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:18 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[135492]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[29649]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:20.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:20 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:20 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:20 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:20 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:20 smithi136 ceph-mon[113230]: pgmap v18: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:20.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:22.106 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: Upgrade: Updating mon.c 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: Deploying daemon mon.c on smithi088 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[135492]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: Upgrade: Updating mon.c 2024-05-25T05:41:22.107 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:22.108 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:22.108 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:22.108 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:22.108 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: Deploying daemon mon.c on smithi088 2024-05-25T05:41:22.108 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:21 smithi088 ceph-mon[29649]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:22.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: Upgrade: Updating mon.c 2024-05-25T05:41:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: from='mgr.44106 ' entity='mgr.y' 2024-05-25T05:41:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: Deploying daemon mon.c on smithi088 2024-05-25T05:41:22.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:21 smithi136 ceph-mon[113230]: pgmap v19: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:23.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:23 smithi088 ceph-mon[135492]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:23.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:23 smithi088 ceph-mon[29649]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:23.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:23 smithi136 ceph-mon[113230]: pgmap v20: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:24.480 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:41:24] "GET /metrics HTTP/1.1" 200 37930 "" "Prometheus/2.43.0" 2024-05-25T05:41:24.742 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:24 smithi088 systemd[1]: Stopping Ceph mon.c for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c[29616]: 2024-05-25T05:41:24.741+0000 7f054ee3d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c[29616]: 2024-05-25T05:41:24.741+0000 7f054ee3d700 -1 mon.c@1(peon) e3 *** Got Signal Terminated *** 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:24 smithi088 podman[140160]: 2024-05-25 05:41:24.987444501 +0000 UTC m=+0.360465757 container died a1ce2ee8464124fc95a43fda31fbac7047e5bbd7a4bc6cdf855364ae90382f08 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, name=centos-stream, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, release=754, version=8, GIT_CLEAN=True, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, ceph=True, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, io.openshift.expose-services=, RELEASE=HEAD) 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:41:24] ENGINE Bus STOPPING 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:41:24] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:41:24] ENGINE Bus STOPPED 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:41:24] ENGINE Bus STARTING 2024-05-25T05:41:25.057 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:41:24] ENGINE Serving on http://:::9283 2024-05-25T05:41:25.058 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:41:24] ENGINE Bus STARTED 2024-05-25T05:41:25.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:25 smithi088 podman[140160]: 2024-05-25 05:41:25.4667038 +0000 UTC m=+0.839725056 container cleanup a1ce2ee8464124fc95a43fda31fbac7047e5bbd7a4bc6cdf855364ae90382f08 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, name=centos-stream, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, architecture=x86_64, io.openshift.expose-services=, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, vcs-type=git, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, GIT_BRANCH=HEAD, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True) 2024-05-25T05:41:25.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:25 smithi088 bash[140160]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c 2024-05-25T05:41:26.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:25 smithi088 podman[140182]: 2024-05-25 05:41:25.743083023 +0000 UTC m=+0.757997574 container remove a1ce2ee8464124fc95a43fda31fbac7047e5bbd7a4bc6cdf855364ae90382f08 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, architecture=x86_64, release=754, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, version=8, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, name=centos-stream, GIT_CLEAN=True) 2024-05-25T05:41:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:25 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.c.service: Deactivated successfully. 2024-05-25T05:41:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:25 smithi088 systemd[1]: Stopped Ceph mon.c for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:41:26.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:25 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.c.service: Consumed 21.790s CPU time. 2024-05-25T05:41:26.420 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 systemd[1]: Starting Ceph mon.c for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:41:26.421 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 podman[140314]: 2024-05-25 05:41:26.206380986 +0000 UTC m=+0.017559008 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:41:26.421 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 podman[140314]: 2024-05-25 05:41:26.310819871 +0000 UTC m=+0.121997872 container create 4ba25386cda91496f1514999de9f5147360f20fdb2a468e534664e544f564174 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, ceph=True, maintainer=Guillaume Abrioux , GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-ea0684c) 2024-05-25T05:41:27.006 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 podman[140314]: 2024-05-25 05:41:26.730893012 +0000 UTC m=+0.542071036 container init 4ba25386cda91496f1514999de9f5147360f20fdb2a468e534664e544f564174 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 podman[140314]: 2024-05-25 05:41:26.734303489 +0000 UTC m=+0.545481502 container start 4ba25386cda91496f1514999de9f5147360f20fdb2a468e534664e544f564174 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , ceph=True, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, RELEASE=squid-ea0684c, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: set uid:gid to 167:167 (ceph:ceph) 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc), process ceph-mon, pid 2 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: pidfile_write: ignore empty --pid-file 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: load: jerasure load: lrc 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: RocksDB version: 7.9.2 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Git sha 0 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Compile date 2024-05-23 20:42:41 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: DB SUMMARY 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: DB Session ID: U2T47KPOR15RPHQA8P8M 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: CURRENT file: CURRENT 2024-05-25T05:41:27.007 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: IDENTITY file: IDENTITY 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: MANIFEST file: MANIFEST-000009 size: 5965 Bytes 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: SST files in /var/lib/ceph/mon/ceph-c/store.db dir, Total Num: 1, files: 000102.sst 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Write Ahead Log file in /var/lib/ceph/mon/ceph-c/store.db: 000100.log size: 722990 ; 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.error_if_exists: 0 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.create_if_missing: 0 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.paranoid_checks: 1 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.flush_verify_memtable_count: 1 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.track_and_verify_wals_in_manifest: 0 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.verify_sst_unique_id_in_manifest: 1 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.env: 0x55feefdacc60 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.fs: PosixFileSystem 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.info_log: 0x55fef091db20 2024-05-25T05:41:27.008 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_file_opening_threads: 16 2024-05-25T05:41:27.009 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.statistics: (nil) 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.use_fsync: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_log_file_size: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_manifest_file_size: 1073741824 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.log_file_time_to_roll: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.keep_log_file_num: 1000 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.recycle_log_file_num: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.allow_fallocate: 1 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.allow_mmap_reads: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.allow_mmap_writes: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.use_direct_reads: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.use_direct_io_for_flush_and_compaction: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.create_missing_column_families: 0 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.db_log_dir: 2024-05-25T05:41:27.010 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.wal_dir: 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.table_cache_numshardbits: 6 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.WAL_ttl_seconds: 0 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.WAL_size_limit_MB: 0 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_write_batch_group_size_bytes: 1048576 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.manifest_preallocation_size: 4194304 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.is_fd_close_on_exec: 1 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.advise_random_on_open: 1 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.db_write_buffer_size: 0 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.write_buffer_manager: 0x55fef08ee820 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.access_hint_on_compaction_start: 1 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.random_access_max_buffer_size: 1048576 2024-05-25T05:41:27.011 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.use_adaptive_mutex: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.rate_limiter: (nil) 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.sst_file_manager.rate_bytes_per_sec: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.wal_recovery_mode: 2 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.enable_thread_tracking: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.enable_pipelined_write: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.unordered_write: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.allow_concurrent_memtable_write: 1 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.enable_write_thread_adaptive_yield: 1 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.write_thread_max_yield_usec: 100 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.write_thread_slow_yield_usec: 3 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.row_cache: None 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.wal_filter: None 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.avoid_flush_during_recovery: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.allow_ingest_behind: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.two_write_queues: 0 2024-05-25T05:41:27.012 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.manual_wal_flush: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.wal_compression: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.atomic_flush: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.avoid_unnecessary_blocking_io: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.persist_stats_to_disk: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.write_dbid_to_manifest: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.log_readahead_size: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.file_checksum_gen_factory: Unknown 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.best_efforts_recovery: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bgerror_resume_count: 2147483647 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bgerror_resume_retry_interval: 1000000 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.allow_data_in_errors: 0 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.db_host_id: __hostname__ 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.enforce_single_del_contracts: true 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_background_jobs: 2 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_background_compactions: -1 2024-05-25T05:41:27.013 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_subcompactions: 1 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.avoid_flush_during_shutdown: 0 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.writable_file_max_buffer_size: 1048576 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.delayed_write_rate : 16777216 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_total_wal_size: 0 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.delete_obsolete_files_period_micros: 21600000000 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.stats_dump_period_sec: 600 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.stats_persist_period_sec: 600 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.stats_history_buffer_size: 1048576 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_open_files: -1 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bytes_per_sync: 0 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.wal_bytes_per_sync: 0 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.strict_bytes_per_sync: 0 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_readahead_size: 0 2024-05-25T05:41:27.014 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_background_flushes: -1 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Compression algorithms supported: 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kZSTDNotFinalCompression supported: 0 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kZSTD supported: 0 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kXpressCompression supported: 0 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kLZ4HCCompression supported: 1 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kZlibCompression supported: 1 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kSnappyCompression supported: 1 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kLZ4Compression supported: 1 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: kBZip2Compression supported: 0 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Fast CRC32 supported: Supported on x86 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: DMutex implementation: pthread_mutex_t 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/version_set.cc:5527] Recovering from manifest file: /var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 2024-05-25T05:41:27.015 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/column_family.cc:630] --------------- Options for column family [default]: 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.comparator: leveldb.BytewiseComparator 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.merge_operator: 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_filter: None 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_filter_factory: None 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.sst_partitioner_factory: None 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.memtable_factory: SkipListFactory 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.table_factory: BlockBasedTable 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: table_factory options: flush_block_policy_factory: FlushBlockBySizePolicyFactory (0x55fef091dc40) 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: cache_index_and_filter_blocks: 1 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: cache_index_and_filter_blocks_with_high_priority: 0 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: pin_l0_filter_and_index_blocks_in_cache: 0 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: pin_top_level_index_and_filter: 1 2024-05-25T05:41:27.016 INFO:journalctl@ceph.mon.c.smithi088.stdout: index_type: 0 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: data_block_index_type: 0 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: index_shortening: 1 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: data_block_hash_table_util_ratio: 0.750000 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: checksum: 4 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: no_block_cache: 0 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_cache: 0x55fef091f090 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_cache_name: BinnedLRUCache 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_cache_options: 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: capacity : 536870912 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: num_shard_bits : 4 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: strict_capacity_limit : 0 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: high_pri_pool_ratio: 0.000 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_cache_compressed: (nil) 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: persistent_cache: (nil) 2024-05-25T05:41:27.017 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_size: 4096 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_size_deviation: 10 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_restart_interval: 16 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: index_block_restart_interval: 1 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: metadata_block_size: 4096 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: partition_filters: 0 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: use_delta_encoding: 1 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: filter_policy: bloomfilter 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: whole_key_filtering: 1 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: verify_compression: 0 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: read_amp_bytes_per_bit: 0 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: format_version: 5 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: enable_index_compression: 1 2024-05-25T05:41:27.018 INFO:journalctl@ceph.mon.c.smithi088.stdout: block_align: 0 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout: max_auto_readahead_size: 262144 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout: prepopulate_block_cache: 0 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout: initial_auto_readahead_size: 8192 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout: num_file_reads_for_auto_readahead: 2 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.write_buffer_size: 33554432 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_write_buffer_number: 2 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression: NoCompression 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression: Disabled 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.prefix_extractor: nullptr 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.memtable_insert_with_hint_prefix_extractor: nullptr 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.num_levels: 7 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.min_write_buffer_number_to_merge: 1 2024-05-25T05:41:27.019 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_write_buffer_number_to_maintain: 0 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_write_buffer_size_to_maintain: 0 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.window_bits: -14 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.level: 32767 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.strategy: 0 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.max_dict_bytes: 0 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.parallel_threads: 1 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.enabled: false 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bottommost_compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.window_bits: -14 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.level: 32767 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.strategy: 0 2024-05-25T05:41:27.020 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.max_dict_bytes: 0 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.zstd_max_train_bytes: 0 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.use_zstd_dict_trainer: true 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.parallel_threads: 1 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.enabled: false 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compression_opts.max_dict_buffer_bytes: 0 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.level0_file_num_compaction_trigger: 4 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.level0_slowdown_writes_trigger: 20 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.level0_stop_writes_trigger: 36 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.target_file_size_base: 67108864 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.target_file_size_multiplier: 1 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_base: 268435456 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.level_compaction_dynamic_level_bytes: 1 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier: 10.000000 2024-05-25T05:41:27.021 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[0]: 1 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[1]: 1 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[2]: 1 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[3]: 1 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[4]: 1 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[5]: 1 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_bytes_for_level_multiplier_addtl[6]: 1 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_sequential_skip_in_iterations: 8 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_compaction_bytes: 1677721600 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.ignore_max_compaction_bytes_for_input: true 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.arena_block_size: 1048576 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.soft_pending_compaction_bytes_limit: 68719476736 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.hard_pending_compaction_bytes_limit: 274877906944 2024-05-25T05:41:27.022 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.disable_auto_compactions: 0 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_style: kCompactionStyleLevel 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_pri: kMinOverlappingRatio 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_universal.size_ratio: 1 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_universal.min_merge_width: 2 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_universal.max_merge_width: 4294967295 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_universal.max_size_amplification_percent: 200 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_universal.compression_size_percent: -1 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_universal.stop_style: kCompactionStopStyleTotalSize 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_fifo.max_table_files_size: 1073741824 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.compaction_options_fifo.allow_compaction: 0 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.table_properties_collectors: 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.inplace_update_support: 0 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.inplace_update_num_locks: 10000 2024-05-25T05:41:27.023 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.memtable_prefix_bloom_size_ratio: 0.000000 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.memtable_whole_key_filtering: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.memtable_huge_page_size: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.bloom_locality: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.max_successive_merges: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.optimize_filters_for_hits: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.paranoid_file_checks: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.force_consistency_checks: 1 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.report_bg_io_stats: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.ttl: 2592000 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.periodic_compaction_seconds: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.preclude_last_level_data_seconds: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.preserve_internal_time_seconds: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.enable_blob_files: false 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.min_blob_size: 0 2024-05-25T05:41:27.024 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.blob_file_size: 268435456 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.blob_compression_type: NoCompression 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.enable_blob_garbage_collection: false 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.blob_garbage_collection_age_cutoff: 0.250000 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.blob_garbage_collection_force_threshold: 1.000000 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.blob_compaction_readahead_size: 0 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.blob_file_starting_level: 0 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: Options.experimental_mempurge_threshold: 0.000000 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [table/block_based/block_based_table_reader.cc:721] At least one SST file opened without unique ID to verify: 102.sst 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/version_set.cc:5566] Recovered from manifest file:/var/lib/ceph/mon/ceph-c/store.db/MANIFEST-000009 succeeded,manifest_file_number is 9, next_file_number is 104, last_sequence is 60039, log_number is 100,prev_log_number is 0,max_column_family is 0,min_log_number_to_keep is 0 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/version_set.cc:5581] Column family [default] (ID 0), log number is 100 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/db_impl/db_impl_open.cc:539] DB ID: b7b213eb-a879-49f1-905d-08a9f0daa1ff 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615686764862, "job": 1, "event": "recovery_started", "wal_files": [100]} 2024-05-25T05:41:27.025 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/db_impl/db_impl_open.cc:1043] Recovering log #100 mode 2 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615686767411, "cf_name": "default", "job": 1, "event": "table_file_creation", "file_number": 105, "file_size": 460139, "file_checksum": "", "file_checksum_func_name": "Unknown", "smallest_seqno": 60044, "largest_seqno": 60516, "table_properties": {"data_size": 457269, "index_size": 1152, "index_partitions": 0, "top_level_index_size": 0, "index_key_is_user_key": 1, "index_value_is_delta_encoded": 1, "filter_size": 709, "raw_key_size": 6982, "raw_average_key_size": 25, "raw_value_size": 452093, "raw_average_value_size": 1643, "num_data_blocks": 47, "num_entries": 275, "num_filter_entries": 275, "num_deletions": 0, "num_merge_operands": 0, "num_range_deletions": 0, "format_version": 0, "fixed_key_len": 0, "filter_policy": "bloomfilter", "column_family_name": "default", "column_family_id": 0, "comparator": "leveldb.BytewiseComparator", "merge_operator": "", "prefix_extractor_name": "nullptr", "property_collectors": "[]", "compression": "NoCompression", "compression_options": "window_bits=-14; level=32767; strategy=0; max_dict_bytes=0; zstd_max_train_bytes=0; enabled=0; max_dict_buffer_bytes=0; use_zstd_dict_trainer=1; ", "creation_time": 1716615686, "oldest_key_time": 0, "file_creation_time": 0, "slow_compression_estimated_data_size": 0, "fast_compression_estimated_data_size": 0, "db_id": "b7b213eb-a879-49f1-905d-08a9f0daa1ff", "db_session_id": "U2T47KPOR15RPHQA8P8M", "orig_file_number": 105, "seqno_to_time_mapping": "N/A"}} 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: EVENT_LOG_v1 {"time_micros": 1716615686767502, "job": 1, "event": "recovery_finished"} 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/version_set.cc:5047] Creating manifest 107 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/version_set.cc:4390] More existing levels in DB than needed. max_bytes_for_level_multiplier may not be guaranteed. 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [file/delete_scheduler.cc:74] Deleted file /var/lib/ceph/mon/ceph-c/store.db/000100.log immediately, rate_bytes_per_sec 0, total_trash_size 0 max_trash_db_ratio 0.250000 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/db_impl/db_impl_open.cc:1987] SstFileManager instance 0x55fef0a0e000 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: DB pointer 0x55fef09f8000 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/db_impl/db_impl.cc:1109] ------- DUMPING STATS ------- 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: rocksdb: [db/db_impl/db_impl.cc:1111] 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout: ** DB Stats ** 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout: Cumulative writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 GB, 0.00 MB/s 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout: Cumulative WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:41:27.026 INFO:journalctl@ceph.mon.c.smithi088.stdout: Cumulative stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: Interval writes: 0 writes, 0 keys, 0 commit groups, 0.0 writes per commit group, ingest: 0.00 MB, 0.00 MB/s 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: Interval WAL: 0 writes, 0 syncs, 0.00 writes per sync, written: 0.00 GB, 0.00 MB/s 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: Interval stall: 00:00:0.000 H:M:S, 0.0 percent 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: Level Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: L0 1/0 449.35 KB 0.2 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 321.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: L6 1/0 13.53 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.00 0.00 0 0.000 0 0 0.0 0.0 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: Sum 2/0 13.97 MB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 321.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: Int 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 1.0 0.0 321.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: ** Compaction Stats [default] ** 2024-05-25T05:41:27.027 INFO:journalctl@ceph.mon.c.smithi088.stdout: Priority Files Size Score Read(GB) Rn(GB) Rnp1(GB) Write(GB) Wnew(GB) Moved(GB) W-Amp Rd(MB/s) Wr(MB/s) Comp(sec) CompMergeCPU(sec) Comp(cnt) Avg(sec) KeyIn KeyDrop Rblob(GB) Wblob(GB) 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: --------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------- 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: User 0/0 0.00 KB 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 0.0 321.0 0.00 0.00 1 0.001 0 0 0.0 0.0 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: Blob file count: 0, total size: 0.0 GB, garbage size: 0.0 GB, space amp: 0.0 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: Uptime(secs): 0.0 total, 0.0 interval 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: Flush(GB): cumulative 0.000, interval 0.000 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: AddFile(GB): cumulative 0.000, interval 0.000 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: AddFile(Total Files): cumulative 0, interval 0 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: AddFile(L0 Files): cumulative 0, interval 0 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: AddFile(Keys): cumulative 0, interval 0 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: Cumulative compaction: 0.00 GB write, 87.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: Interval compaction: 0.00 GB write, 87.96 MB/s write, 0.00 GB read, 0.00 MB/s read, 0.0 seconds 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: Stalls(count): 0 level0_slowdown, 0 level0_slowdown_with_compaction, 0 level0_numfiles, 0 level0_numfiles_with_compaction, 0 stop for pending_compaction_bytes, 0 slowdown for pending_compaction_bytes, 0 memtable_compaction, 0 memtable_slowdown, interval 0 total count 2024-05-25T05:41:27.028 INFO:journalctl@ceph.mon.c.smithi088.stdout: Block cache BinnedLRUCache@0x55fef091f090#2 capacity: 512.00 MB usage: 1.98 KB table_size: 0 occupancy: 18446744073709551615 collections: 1 last_copies: 0 last_secs: 9e-06 secs_since: 0 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: Block cache entry stats(count,size,portion): FilterBlock(1,0.78 KB,0.000149012%) IndexBlock(1,1.20 KB,0.000229478%) Misc(1,0.00 KB,0%) 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: ** File Read Latency Histogram By Level [default] ** 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: starting mon.c rank 1 at public addrs [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] at bind addrs [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon_data /var/lib/ceph/mon/ceph-c fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???) e3 preinit fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???).mds e1 new map 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???).mds e1 print_map 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: e1 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: enable_multiple, ever_enabled_multiple: 1,1 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: default compat: compat={},rocompat={},incompat={1=base v0.20,2=client writeable ranges,3=default file layouts on dirs,4=dir inode in separate object,5=mds uses versioned encoding,6=dirfrag is stored in omap,8=no anchor table,9=file layout v2,10=snaprealm v2} 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: legacy client fscid: -1 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: 2024-05-25T05:41:27.029 INFO:journalctl@ceph.mon.c.smithi088.stdout: No filesystems configured 2024-05-25T05:41:27.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???).osd e114 crush map has features 3314933000854323200, adjusting msgr requires 2024-05-25T05:41:27.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:41:27.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:41:27.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???).osd e114 crush map has features 432629239337189376, adjusting msgr requires 2024-05-25T05:41:27.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 ceph-mon[140333]: mon.c@-1(???).paxosservice(auth 1..32) refresh upgraded, format 0 -> 3 2024-05-25T05:41:27.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 bash[140314]: 4ba25386cda91496f1514999de9f5147360f20fdb2a468e534664e544f564174 2024-05-25T05:41:27.030 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:26 smithi088 systemd[1]: Started Ceph mon.c for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:41:28.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:27 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:41:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:27 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:41:28.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:27 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:41:28.236 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:27 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:41:28.237 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:27 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:41:28.237 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:27 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:41:28.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:27 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:41:28.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:27 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:41:28.237 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:27 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:41:28.940 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: mgrmap e48: y(active, since 38s), standbys: x 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: overall HEALTH_OK 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: mon.c calling monitor election 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: mon.b calling monitor election 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: mon.a calling monitor election 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: monmap epoch 4 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: last_changed 2024-05-25T05:41:27.823717+0000 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:41:28.941 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: min_mon_release 19 (squid) 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: election_strategy: 1 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: fsmap 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: mgrmap e48: y(active, since 38s), standbys: x 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: overall HEALTH_OK 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:28.942 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: Reconfiguring mon.a (monmap changed)... 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[140333]: Reconfiguring daemon mon.a on smithi088 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: mgrmap e48: y(active, since 38s), standbys: x 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: overall HEALTH_OK 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: mon.c calling monitor election 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: mon.b calling monitor election 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:41:28.943 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: mon.a calling monitor election 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: monmap epoch 4 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: last_changed 2024-05-25T05:41:27.823717+0000 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: min_mon_release 19 (squid) 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: election_strategy: 1 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: fsmap 2024-05-25T05:41:28.944 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: mgrmap e48: y(active, since 38s), standbys: x 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: overall HEALTH_OK 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: Reconfiguring mon.a (monmap changed)... 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:28.945 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:28 smithi088 ceph-mon[135492]: Reconfiguring daemon mon.a on smithi088 2024-05-25T05:41:29.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: pgmap v22: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:29.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: mgrmap e48: y(active, since 38s), standbys: x 2024-05-25T05:41:29.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: overall HEALTH_OK 2024-05-25T05:41:29.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: mon.c calling monitor election 2024-05-25T05:41:29.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: mon.b calling monitor election 2024-05-25T05:41:29.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "a"}]: dispatch 2024-05-25T05:41:29.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "b"}]: dispatch 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mon metadata", "id": "c"}]: dispatch 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: mon.a calling monitor election 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: mon.a is new leader, mons a,c,b in quorum (ranks 0,1,2) 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: monmap epoch 4 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: fsid 9a885618-1a54-11ef-bc9b-c7b262605968 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: last_changed 2024-05-25T05:41:27.823717+0000 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: created 2024-05-25T05:07:22.732162+0000 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: min_mon_release 19 (squid) 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: election_strategy: 1 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: 0: [v2:172.21.15.88:3300/0,v1:172.21.15.88:6789/0] mon.a 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: 1: [v2:172.21.15.88:3301/0,v1:172.21.15.88:6790/0] mon.c 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: 2: [v2:172.21.15.136:3300/0,v1:172.21.15.136:6789/0] mon.b 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: fsmap 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: osdmap e114: 8 total, 8 up, 8 in 2024-05-25T05:41:29.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: mgrmap e48: y(active, since 38s), standbys: x 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: overall HEALTH_OK 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: Reconfiguring mon.a (monmap changed)... 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:29.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:28 smithi136 ceph-mon[113230]: Reconfiguring daemon mon.a on smithi088 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: Reconfiguring mgr.y (monmap changed)... 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[135492]: Reconfiguring daemon mgr.y on smithi088 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: Reconfiguring mgr.y (monmap changed)... 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:31.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:30 smithi088 ceph-mon[140333]: Reconfiguring daemon mgr.y on smithi088 2024-05-25T05:41:31.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: pgmap v23: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: Reconfiguring mgr.y (monmap changed)... 2024-05-25T05:41:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.y", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:41:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:41:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:31.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:30 smithi136 ceph-mon[113230]: Reconfiguring daemon mgr.y on smithi088 2024-05-25T05:41:31.932 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:31 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:41:31.775+0000 7f19fd064700 -1 mgr.server handle_report got status from non-daemon mon.c 2024-05-25T05:41:32.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:32.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:32.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:32.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:32.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:32.258 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:32.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:32.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:32.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:32.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:32.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:32.259 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:31 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:31 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:31 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:31 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:31 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:31 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:31 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:33.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:32 smithi088 ceph-mon[135492]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:33.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:32 smithi088 ceph-mon[135492]: Reconfiguring mon.c (monmap changed)... 2024-05-25T05:41:33.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:32 smithi088 ceph-mon[135492]: Reconfiguring daemon mon.c on smithi088 2024-05-25T05:41:33.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:32 smithi088 ceph-mon[140333]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:33.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:32 smithi088 ceph-mon[140333]: Reconfiguring mon.c (monmap changed)... 2024-05-25T05:41:33.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:32 smithi088 ceph-mon[140333]: Reconfiguring daemon mon.c on smithi088 2024-05-25T05:41:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:32 smithi136 ceph-mon[113230]: pgmap v24: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:32 smithi136 ceph-mon[113230]: Reconfiguring mon.c (monmap changed)... 2024-05-25T05:41:33.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:32 smithi136 ceph-mon[113230]: Reconfiguring daemon mon.c on smithi088 2024-05-25T05:41:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:41:34] "GET /metrics HTTP/1.1" 200 37930 "" "Prometheus/2.43.0" 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:41:34.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:34 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:34.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:34 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:34.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:34 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:34.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:34 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:41:34.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:34 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:35.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:35.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: Reconfiguring osd.0 (monmap changed)... 2024-05-25T05:41:35.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.0 on smithi088 2024-05-25T05:41:35.548 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:35.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:35.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:35.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-25T05:41:35.549 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:35 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:35.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: Reconfiguring osd.0 (monmap changed)... 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.0 on smithi088 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: pgmap v25: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: Reconfiguring osd.0 (monmap changed)... 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.0 on smithi088 2024-05-25T05:41:35.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.1"}]: dispatch 2024-05-25T05:41:35.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:35 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:36.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:36 smithi088 ceph-mon[140333]: Reconfiguring osd.1 (monmap changed)... 2024-05-25T05:41:36.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:36 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.1 on smithi088 2024-05-25T05:41:36.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:36 smithi088 ceph-mon[135492]: Reconfiguring osd.1 (monmap changed)... 2024-05-25T05:41:36.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:36 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.1 on smithi088 2024-05-25T05:41:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:36 smithi136 ceph-mon[113230]: Reconfiguring osd.1 (monmap changed)... 2024-05-25T05:41:36.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:36 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.1 on smithi088 2024-05-25T05:41:37.660 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[140333]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[135492]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-25T05:41:37.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:37.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:37 smithi136 ceph-mon[113230]: pgmap v26: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:37.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:37.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:37.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.2"}]: dispatch 2024-05-25T05:41:37.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:38.671 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:38 smithi136 ceph-mon[113230]: Reconfiguring osd.2 (monmap changed)... 2024-05-25T05:41:38.671 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:38 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.2 on smithi088 2024-05-25T05:41:38.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:38 smithi088 ceph-mon[140333]: Reconfiguring osd.2 (monmap changed)... 2024-05-25T05:41:38.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:38 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.2 on smithi088 2024-05-25T05:41:38.674 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:38 smithi088 ceph-mon[135492]: Reconfiguring osd.2 (monmap changed)... 2024-05-25T05:41:38.674 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:38 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.2 on smithi088 2024-05-25T05:41:39.549 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-25T05:41:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.562 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:41:39.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:39.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-25T05:41:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: pgmap v27: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.3"}]: dispatch 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:39.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:40.258 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:41:40.258 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 1s ago 33m - - 2024-05-25T05:41:40.258 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 1s ago 32m - - 2024-05-25T05:41:40.258 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (3m) 1s ago 27m 21.2M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:41:40.258 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (2m) 1s ago 27m 79.6M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:41:40.258 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (6m) 1s ago 26m 60.6M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:41:40.258 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (5m) 1s ago 32m 450M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (16m) 1s ago 33m 505M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (35s) 1s ago 34m 39.0M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 a339af319c03 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (113s) 1s ago 32m 43.2M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (32m) 1s ago 32m 82.7M 2048M 17.2.0 e1d6a67b021e a1ce2ee84641 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (5m) 1s ago 28m 15.7M - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (5m) 1s ago 28m 15.1M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (32m) 1s ago 32m 54.9M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (31m) 1s ago 31m 56.1M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (31m) 1s ago 31m 50.6M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (30m) 1s ago 30m 56.5M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (30m) 1s ago 30m 57.1M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (30m) 1s ago 30m 52.5M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:41:40.259 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (29m) 1s ago 29m 54.7M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:41:40.260 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (29m) 1s ago 29m 55.8M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:41:40.260 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (4m) 1s ago 28m 69.8M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:41:40.260 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (26m) 1s ago 26m 78.4M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:41:40.260 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (26m) 1s ago 26m 80.0M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 3 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:41:40.669 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:41:40.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:40.670 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:41:40.670 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:41:40.670 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:41:40.670 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:41:40.670 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-05-25T05:41:40.670 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 5 2024-05-25T05:41:40.671 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:41:40.671 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:41:40.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:40 smithi088 ceph-mon[135492]: Reconfiguring osd.3 (monmap changed)... 2024-05-25T05:41:40.671 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:40 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.3 on smithi088 2024-05-25T05:41:40.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:40 smithi088 ceph-mon[140333]: Reconfiguring osd.3 (monmap changed)... 2024-05-25T05:41:40.672 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:40 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.3 on smithi088 2024-05-25T05:41:40.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:40 smithi136 ceph-mon[113230]: Reconfiguring osd.3 (monmap changed)... 2024-05-25T05:41:40.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:40 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.3 on smithi088 2024-05-25T05:41:41.010 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) mon on host(s) smithi088", 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/2 daemons upgraded", 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading mon daemons", 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:41:41.011 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:41:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[135492]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[135492]: from='client.54132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[135492]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[135492]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/4201803397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:41.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[135492]: from='client.54153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[140333]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:41.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[140333]: from='client.54132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[140333]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[140333]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:41.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[140333]: from='client.? 172.21.15.88:0/4201803397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:41.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:41 smithi088 ceph-mon[140333]: from='client.54153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:41 smithi136 ceph-mon[113230]: pgmap v28: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:41 smithi136 ceph-mon[113230]: from='client.54132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:41 smithi136 ceph-mon[113230]: from='client.64108 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:41 smithi136 ceph-mon[113230]: from='client.64114 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:41 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:41 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/4201803397' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:41.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:41 smithi136 ceph-mon[113230]: from='client.54153 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: Reconfiguring rgw.foo.smithi088.beqodg (monmap changed)... 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: Reconfiguring daemon rgw.foo.smithi088.beqodg on smithi088 2024-05-25T05:41:43.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: Reconfiguring rgw.foo.smithi088.beqodg (monmap changed)... 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: Reconfiguring daemon rgw.foo.smithi088.beqodg on smithi088 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:43 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: pgmap v29: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: Reconfiguring rgw.foo.smithi088.beqodg (monmap changed)... 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi088.beqodg", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: Reconfiguring daemon rgw.foo.smithi088.beqodg on smithi088 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:43 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:44.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:41:44] "GET /metrics HTTP/1.1" 200 37939 "" "Prometheus/2.43.0" 2024-05-25T05:41:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:45.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: Reconfiguring mon.b (monmap changed)... 2024-05-25T05:41:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:45.308 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[135492]: Reconfiguring daemon mon.b on smithi136 2024-05-25T05:41:45.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:45.308 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:45.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:45.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: Reconfiguring mon.b (monmap changed)... 2024-05-25T05:41:45.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:45.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:45.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:45.309 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:45 smithi088 ceph-mon[140333]: Reconfiguring daemon mon.b on smithi136 2024-05-25T05:41:45.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: pgmap v30: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:45.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:45.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:45.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: Reconfiguring mon.b (monmap changed)... 2024-05-25T05:41:45.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "mon."}]: dispatch 2024-05-25T05:41:45.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config get", "who": "mon", "key": "public_network"}]: dispatch 2024-05-25T05:41:45.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:45.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:45 smithi136 ceph-mon[113230]: Reconfiguring daemon mon.b on smithi136 2024-05-25T05:41:47.114 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:47.114 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:47.114 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:47.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: Reconfiguring mgr.x (monmap changed)... 2024-05-25T05:41:47.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:41:47.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:41:47.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:47.115 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:46 smithi136 ceph-mon[113230]: Reconfiguring daemon mgr.x on smithi136 2024-05-25T05:41:47.188 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:47.188 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:47.188 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:47.188 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: Reconfiguring mgr.x (monmap changed)... 2024-05-25T05:41:47.188 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:41:47.188 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[140333]: Reconfiguring daemon mgr.x on smithi136 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: pgmap v31: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: Reconfiguring mgr.x (monmap changed)... 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "mgr.x", "caps": ["mon", "profile mgr", "osd", "allow *", "mds", "allow *"]}]: dispatch 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "mgr services"}]: dispatch 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:47.189 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:46 smithi088 ceph-mon[135492]: Reconfiguring daemon mgr.x on smithi136 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[140333]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[140333]: Reconfiguring osd.4 (monmap changed)... 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.4 on smithi136 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[135492]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[135492]: Reconfiguring osd.4 (monmap changed)... 2024-05-25T05:41:48.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-25T05:41:48.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:48.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:48 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.4 on smithi136 2024-05-25T05:41:48.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:48 smithi136 ceph-mon[113230]: pgmap v32: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:48.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:48 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:48.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:48 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:48.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:48 smithi136 ceph-mon[113230]: Reconfiguring osd.4 (monmap changed)... 2024-05-25T05:41:48.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:48 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.4"}]: dispatch 2024-05-25T05:41:48.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:48 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:48.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:48 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.4 on smithi136 2024-05-25T05:41:50.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:50.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:50.761 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:50.762 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: Reconfiguring osd.5 (monmap changed)... 2024-05-25T05:41:50.762 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-25T05:41:50.762 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:50.762 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:50.762 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:50 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.5 on smithi136 2024-05-25T05:41:50.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:50.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: Reconfiguring osd.5 (monmap changed)... 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.5 on smithi136 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: pgmap v33: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: Reconfiguring osd.5 (monmap changed)... 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.5"}]: dispatch 2024-05-25T05:41:50.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:41:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:50.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:50 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.5 on smithi136 2024-05-25T05:41:52.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:52 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:52 smithi136 ceph-mon[113230]: Reconfiguring osd.6 (monmap changed)... 2024-05-25T05:41:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-25T05:41:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:52.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:52 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.6 on smithi136 2024-05-25T05:41:52.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[140333]: Reconfiguring osd.6 (monmap changed)... 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.6 on smithi136 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:52.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[135492]: Reconfiguring osd.6 (monmap changed)... 2024-05-25T05:41:52.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.6"}]: dispatch 2024-05-25T05:41:52.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:52.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:52 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.6 on smithi136 2024-05-25T05:41:53.499 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:53 smithi136 ceph-mon[113230]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:53.499 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:53.499 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:53.499 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-25T05:41:53.499 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[140333]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[135492]: pgmap v34: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.7"}]: dispatch 2024-05-25T05:41:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:54 smithi088 ceph-mon[140333]: Reconfiguring osd.7 (monmap changed)... 2024-05-25T05:41:54.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:54 smithi088 ceph-mon[140333]: Reconfiguring daemon osd.7 on smithi136 2024-05-25T05:41:54.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:54 smithi088 ceph-mon[135492]: Reconfiguring osd.7 (monmap changed)... 2024-05-25T05:41:54.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:54 smithi088 ceph-mon[135492]: Reconfiguring daemon osd.7 on smithi136 2024-05-25T05:41:54.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:41:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:41:54] "GET /metrics HTTP/1.1" 200 37939 "" "Prometheus/2.43.0" 2024-05-25T05:41:54.567 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:54 smithi136 ceph-mon[113230]: Reconfiguring osd.7 (monmap changed)... 2024-05-25T05:41:54.568 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:54 smithi136 ceph-mon[113230]: Reconfiguring daemon osd.7 on smithi136 2024-05-25T05:41:55.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:55 smithi136 ceph-mon[113230]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:55.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:55.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:55.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:41:55.505 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:55.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[140333]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[135492]: pgmap v35: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get-or-create", "entity": "client.rgw.foo.smithi136.bfemvm", "caps": ["mon", "allow *", "mgr", "allow rw", "osd", "allow rwx tag rgw *=*"]}]: dispatch 2024-05-25T05:41:55.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:56.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:56 smithi088 ceph-mon[140333]: Reconfiguring rgw.foo.smithi136.bfemvm (monmap changed)... 2024-05-25T05:41:56.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:56 smithi088 ceph-mon[140333]: Reconfiguring daemon rgw.foo.smithi136.bfemvm on smithi136 2024-05-25T05:41:56.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:56 smithi088 ceph-mon[135492]: Reconfiguring rgw.foo.smithi136.bfemvm (monmap changed)... 2024-05-25T05:41:56.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:56 smithi088 ceph-mon[135492]: Reconfiguring daemon rgw.foo.smithi136.bfemvm on smithi136 2024-05-25T05:41:56.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:56 smithi136 ceph-mon[113230]: Reconfiguring rgw.foo.smithi136.bfemvm (monmap changed)... 2024-05-25T05:41:56.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:56 smithi136 ceph-mon[113230]: Reconfiguring daemon rgw.foo.smithi136.bfemvm on smithi136 2024-05-25T05:41:57.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:57 smithi136 ceph-mon[113230]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:57.556 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:57 smithi088 ceph-mon[135492]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:57.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:57 smithi088 ceph-mon[140333]: pgmap v36: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:41:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all mon 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all crash 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all mds 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all nfs 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all mon 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all crash 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all mds 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all nfs 2024-05-25T05:41:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all node-exporter 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all prometheus 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all alertmanager 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all grafana 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all loki 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all promtail 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Finalizing container_image settings 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:41:58.815 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:41:58.816 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.817 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: Upgrade: Complete! 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:58.818 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all node-exporter 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.819 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all prometheus 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all alertmanager 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all grafana 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all loki 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.820 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all promtail 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Finalizing container_image settings 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:41:58.821 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.822 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: Upgrade: Complete! 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:58.823 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: pgmap v37: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all mon 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]': finished 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]': finished 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all crash 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all mds 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all rbd-mirror 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all cephfs-mirror 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all ceph-exporter 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all nfs 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all node-exporter 2024-05-25T05:41:58.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all prometheus 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all alertmanager 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all grafana 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all loki 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all promtail 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.a"}]: dispatch 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon.c"}]: dispatch 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Finalizing container_image settings 2024-05-25T05:41:58.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mds"}]': finished 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:41:58.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]': finished 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]': finished 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]': finished 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: Upgrade: Complete! 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:41:58.892 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.858 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.859 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.859 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:41:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:41:59.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:41:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:00 smithi136 ceph-mon[113230]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[140333]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[135492]: pgmap v38: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:01.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:02.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:01 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:02.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:01 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:02.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:01 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:03.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:02 smithi136 ceph-mon[113230]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:03.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:02 smithi088 ceph-mon[140333]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:03.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:02 smithi088 ceph-mon[135492]: pgmap v39: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:04.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:42:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:42:04] "GET /metrics HTTP/1.1" 200 37939 "" "Prometheus/2.43.0" 2024-05-25T05:42:05.032 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:04 smithi088 ceph-mon[140333]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:05.032 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:05.032 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:04 smithi088 ceph-mon[135492]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:05.032 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:04 smithi136 ceph-mon[113230]: pgmap v40: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:07.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:06 smithi136 ceph-mon[113230]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:07.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:06 smithi088 ceph-mon[135492]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:07.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:06 smithi088 ceph-mon[140333]: pgmap v41: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:09.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:08 smithi136 ceph-mon[113230]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:09.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:08 smithi088 ceph-mon[135492]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:09.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:08 smithi088 ceph-mon[140333]: pgmap v42: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:11.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:10 smithi136 ceph-mon[113230]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:11.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:10 smithi088 ceph-mon[140333]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:11.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:10 smithi088 ceph-mon[135492]: pgmap v43: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:11.973 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:11 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:11.973 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:11 smithi088 ceph-mon[140333]: from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:11.973 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:11 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:11.973 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:11 smithi088 ceph-mon[135492]: from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:11.997 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:42:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:11 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:12.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:11 smithi136 ceph-mon[113230]: from='client.64132 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:13.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:12 smithi136 ceph-mon[113230]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:13.187 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:12 smithi088 ceph-mon[135492]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:13.188 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:12 smithi088 ceph-mon[140333]: pgmap v44: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 13s ago 33m - - 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 15s ago 33m - - 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (4m) 13s ago 28m 27.1M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (3m) 15s ago 28m 79.5M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (6m) 13s ago 27m 61.7M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (6m) 15s ago 32m 450M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (17m) 13s ago 34m 509M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (69s) 13s ago 34m 43.3M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 a339af319c03 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (2m) 15s ago 33m 43.2M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:42:13.828 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (47s) 13s ago 33m 33.5M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 4ba25386cda9 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (5m) 13s ago 29m 15.4M - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (5m) 15s ago 29m 15.1M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (32m) 13s ago 32m 55.2M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (32m) 13s ago 32m 56.1M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (31m) 13s ago 31m 50.8M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (31m) 13s ago 31m 56.5M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (31m) 15s ago 31m 57.1M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (30m) 15s ago 30m 52.5M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (30m) 15s ago 30m 54.7M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (29m) 15s ago 29m 55.9M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (4m) 15s ago 29m 69.8M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (27m) 13s ago 27m 78.7M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:42:13.829 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (27m) 15s ago 27m 80.1M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:42:14.428 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:42:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:42:14] "GET /metrics HTTP/1.1" 200 37935 "" "Prometheus/2.43.0" 2024-05-25T05:42:14.453 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.mon | length == 1'"'"'' 2024-05-25T05:42:15.048 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:14 smithi088 ceph-mon[135492]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:15.048 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:14 smithi088 ceph-mon[135492]: from='client.54165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:15.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:14 smithi088 ceph-mon[140333]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:15.049 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:14 smithi088 ceph-mon[140333]: from='client.54165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:14 smithi136 ceph-mon[113230]: pgmap v45: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:15.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:14 smithi136 ceph-mon[113230]: from='client.54165 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:16.474 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:42:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:16 smithi136 ceph-mon[113230]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:16 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/1079820066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:17.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:16 smithi088 ceph-mon[135492]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:17.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:16 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/1079820066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:17.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:16 smithi088 ceph-mon[140333]: pgmap v46: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:17.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:16 smithi088 ceph-mon[140333]: from='client.? 172.21.15.88:0/1079820066' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:17.397 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.mon | keys'"'"' | grep $sha1' 2024-05-25T05:42:18.921 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[140333]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:18.921 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:18.921 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:18.921 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:18.921 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[135492]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:18.921 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:18.921 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:18.922 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:19.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:18 smithi136 ceph-mon[113230]: pgmap v47: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:19.103 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:19.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:19.104 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:19.419 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)" 2024-05-25T05:42:20.031 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 5'"'"'' 2024-05-25T05:42:20.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:19 smithi088 ceph-mon[140333]: from='client.? 172.21.15.88:0/1616082340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:20.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:19 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/1616082340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:20.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:20.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:19 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/1616082340' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:20.386 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:21.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[140333]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:21.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.298 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.299 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[135492]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:21.299 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.299 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.299 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:20 smithi136 ceph-mon[113230]: pgmap v48: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:21.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:22.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:21 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:22.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:21 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:22.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:21 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:23.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:22 smithi088 ceph-mon[135492]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:22 smithi088 ceph-mon[135492]: from='client.64156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:23.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:22 smithi088 ceph-mon[140333]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:23.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:22 smithi088 ceph-mon[140333]: from='client.64156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:23.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:22 smithi136 ceph-mon[113230]: pgmap v49: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:23.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:22 smithi136 ceph-mon[113230]: from='client.64156 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:24.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:42:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:42:24] "GET /metrics HTTP/1.1" 200 37936 "" "Prometheus/2.43.0" 2024-05-25T05:42:25.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:24 smithi088 ceph-mon[135492]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:25.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:24 smithi088 ceph-mon[140333]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:25.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:24 smithi136 ceph-mon[113230]: pgmap v50: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:25.996 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:42:26.626 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade status' 2024-05-25T05:42:27.217 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:26 smithi088 ceph-mon[140333]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:27.218 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:26 smithi088 ceph-mon[135492]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:27.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:26 smithi136 ceph-mon[113230]: pgmap v51: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:28.693 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:42:28.693 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": null, 2024-05-25T05:42:28.693 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": false, 2024-05-25T05:42:28.694 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "", 2024-05-25T05:42:28.694 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:42:28.694 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": null, 2024-05-25T05:42:28.694 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "", 2024-05-25T05:42:28.694 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:42:28.694 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:42:29.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:28 smithi088 ceph-mon[140333]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:29.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:28 smithi088 ceph-mon[135492]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:29.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:28 smithi136 ceph-mon[113230]: pgmap v52: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:29.419 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph health detail' 2024-05-25T05:42:30.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:29 smithi088 ceph-mon[140333]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:30.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:29 smithi088 ceph-mon[135492]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:30.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:29 smithi136 ceph-mon[113230]: from='client.64162 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:31.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:30 smithi088 ceph-mon[135492]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:31.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:30 smithi088 ceph-mon[140333]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:31.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:30 smithi136 ceph-mon[113230]: pgmap v53: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:31.491 INFO:teuthology.orchestra.run.smithi088.stdout:HEALTH_OK 2024-05-25T05:42:32.109 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:32 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:32.109 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:32 smithi088 ceph-mon[140333]: from='client.? 172.21.15.88:0/2077820214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:42:32.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:32 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:32.109 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:32 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/2077820214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:42:32.132 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade start --image quay.ceph.io/ceph-ci/ceph:$sha1 --daemon-types osd --limit 2' 2024-05-25T05:42:32.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:32 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:32.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:32 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/2077820214' entity='client.admin' cmd=[{"prefix": "health", "detail": "detail"}]: dispatch 2024-05-25T05:42:33.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:33 smithi088 ceph-mon[140333]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:33.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:33 smithi088 ceph-mon[135492]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:33.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:33 smithi136 ceph-mon[113230]: pgmap v54: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:42:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:42:34] "GET /metrics HTTP/1.1" 200 37936 "" "Prometheus/2.43.0" 2024-05-25T05:42:35.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:35 smithi088 ceph-mon[140333]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:35.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:35 smithi088 ceph-mon[140333]: from='client.54201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:35.307 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:35 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:35.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:35 smithi088 ceph-mon[135492]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:35.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:35 smithi088 ceph-mon[135492]: from='client.54201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:35.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:35 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:35 smithi136 ceph-mon[113230]: pgmap v55: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:35.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:35 smithi136 ceph-mon[113230]: from='client.54201 -' entity='client.admin' cmd=[{"prefix": "orch upgrade start", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "daemon_types": "osd", "limit": 2, "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:35.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:35 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:36.346 INFO:teuthology.orchestra.run.smithi088.stdout:Initiating upgrade to quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:42:37.039 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'while ceph orch upgrade status | jq '"'"'.in_progress'"'"' | grep true && ! ceph orch upgrade status | jq '"'"'.message'"'"' | grep Error ; do ceph orch ps ; ceph versions ; ceph orch upgrade status ; sleep 30 ; done' 2024-05-25T05:42:37.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:37 smithi136 ceph-mon[113230]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:37 smithi136 ceph-mon[113230]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:42:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:37.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:37 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:37.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[140333]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:37.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[140333]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:42:37.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:37.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:37.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:37.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:37.644 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:37.645 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[135492]: pgmap v56: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:37.645 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[135492]: Upgrade: Started with target quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:42:37.645 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:37.645 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:37.645 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:37.645 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:37.645 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:37 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:38.385 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:38 smithi136 ceph-mon[113230]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:42:38.624 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:38 smithi088 ceph-mon[140333]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:42:38.624 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:38 smithi088 ceph-mon[135492]: Upgrade: First pull of quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78 2024-05-25T05:42:39.607 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:39 smithi136 ceph-mon[113230]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:39.607 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.607 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.607 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:39 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[135492]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:39.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.739 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.739 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[140333]: pgmap v57: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:39.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:39.740 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:39 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:40.476 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all mgr 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all mon 2024-05-25T05:42:41.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all crash 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: Upgrade: osd.0 is safe to restart 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all mgr 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all mon 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all crash 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:42:41.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:42:41.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: Upgrade: osd.0 is safe to restart 2024-05-25T05:42:41.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: pgmap v58: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: Upgrade: Target is version 19.0.0-2843-gea0684c0 (squid) 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: Upgrade: Target container is quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, digests ['quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee'] 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all mgr 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all mon 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all crash 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: Upgrade: osd.0 is safe to restart 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:41.148 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:42:41.148 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 1s ago 34m - - 2024-05-25T05:42:41.149 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 2s ago 33m - - 2024-05-25T05:42:41.149 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (4m) 1s ago 28m 26.8M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:42:41.149 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (3m) 2s ago 28m 80.5M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:42:41.149 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (7m) 1s ago 27m 63.8M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:42:41.149 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (6m) 2s ago 33m 451M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:42:41.149 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (17m) 1s ago 34m 513M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (96s) 1s ago 35m 44.1M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 a339af319c03 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (2m) 2s ago 33m 44.9M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (74s) 1s ago 33m 35.4M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 4ba25386cda9 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (6m) 1s ago 29m 15.2M - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (6m) 2s ago 29m 14.7M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (33m) 1s ago 33m 55.3M 4096M 17.2.0 e1d6a67b021e eec073e494d9 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (32m) 1s ago 32m 56.1M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (32m) 1s ago 32m 50.8M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (31m) 1s ago 31m 56.5M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (31m) 2s ago 31m 57.1M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (31m) 2s ago 31m 52.5M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (30m) 2s ago 30m 54.7M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:42:41.150 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (30m) 2s ago 30m 55.9M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:42:41.151 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (5m) 2s ago 29m 69.9M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:42:41.151 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (28m) 1s ago 27m 78.8M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:42:41.151 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (27m) 2s ago 27m 80.2M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:42:41.574 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 3 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 8 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:42:41.575 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:42:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:42:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 10, 2024-05-25T05:42:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 5 2024-05-25T05:42:41.576 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:42:41.576 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:42:41.927 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (2 remaining).", 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "0/8 daemons upgraded", 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:42:41.928 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='client.54207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='client.54219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: Upgrade: Updating osd.0 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: Deploying daemon osd.0 on smithi088 2024-05-25T05:42:42.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/4046948254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='client.54207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='client.54219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: Upgrade: Updating osd.0 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: Deploying daemon osd.0 on smithi088 2024-05-25T05:42:42.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:42 smithi088 ceph-mon[140333]: from='client.? 172.21.15.88:0/4046948254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:42.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='client.54207 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='client.64186 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='client.54219 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: Upgrade: Updating osd.0 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: Deploying daemon osd.0 on smithi088 2024-05-25T05:42:42.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:42 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/4046948254' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:43.542 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:43 smithi088 ceph-mon[140333]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:43.542 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:43 smithi088 ceph-mon[140333]: from='client.64204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:43.543 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:43 smithi088 ceph-mon[135492]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:43.543 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:43 smithi088 ceph-mon[135492]: from='client.64204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:43.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:43 smithi136 ceph-mon[113230]: pgmap v59: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:43.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:43 smithi136 ceph-mon[113230]: from='client.64204 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:42:44.520 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:42:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:42:44] "GET /metrics HTTP/1.1" 200 37866 "" "Prometheus/2.43.0" 2024-05-25T05:42:45.337 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:45 smithi088 systemd[1]: Stopping Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:42:45.623 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:45 smithi088 ceph-mon[140333]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:45.624 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:45 smithi088 ceph-mon[135492]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:45.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:45 smithi136 ceph-mon[113230]: pgmap v60: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:42:46.056 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[32920]: 2024-05-25T05:42:45.623+0000 7fcf24fc5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:42:46.056 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[32920]: 2024-05-25T05:42:45.623+0000 7fcf24fc5700 -1 osd.0 114 *** Got signal Terminated *** 2024-05-25T05:42:46.057 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:45 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[32920]: 2024-05-25T05:42:45.623+0000 7fcf24fc5700 -1 osd.0 114 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:42:46.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:46 smithi136 ceph-mon[113230]: osd.0 marked itself down and dead 2024-05-25T05:42:46.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:46 smithi088 ceph-mon[140333]: osd.0 marked itself down and dead 2024-05-25T05:42:46.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:46 smithi088 ceph-mon[135492]: osd.0 marked itself down and dead 2024-05-25T05:42:47.164 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:46 smithi088 podman[144939]: 2024-05-25 05:42:46.900098949 +0000 UTC m=+1.381552116 container died eec073e494d9a9d843d3449bd2f51dbdafb3543f8bea40abe1ed1e6d9cf772f6 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, release=754, vendor=Red Hat, Inc., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, GIT_CLEAN=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , name=centos-stream, ceph=True, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-05-25T05:42:47.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:47 smithi088 ceph-mon[140333]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:47.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:47 smithi088 ceph-mon[140333]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-25T05:42:47.432 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:47 smithi088 ceph-mon[140333]: osdmap e115: 8 total, 7 up, 8 in 2024-05-25T05:42:47.433 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:47 smithi088 ceph-mon[135492]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:47.433 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:47 smithi088 ceph-mon[135492]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-25T05:42:47.433 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:47 smithi088 ceph-mon[135492]: osdmap e115: 8 total, 7 up, 8 in 2024-05-25T05:42:47.433 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:47 smithi088 podman[144939]: 2024-05-25 05:42:47.164946343 +0000 UTC m=+1.646399501 container cleanup eec073e494d9a9d843d3449bd2f51dbdafb3543f8bea40abe1ed1e6d9cf772f6 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, name=centos-stream, GIT_CLEAN=True, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-25T05:42:47.433 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:47 smithi088 bash[144939]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0 2024-05-25T05:42:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:47 smithi136 ceph-mon[113230]: pgmap v61: 161 pgs: 161 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:47 smithi136 ceph-mon[113230]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-25T05:42:47.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:47 smithi136 ceph-mon[113230]: osdmap e115: 8 total, 7 up, 8 in 2024-05-25T05:42:47.794 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:47 smithi088 podman[144956]: 2024-05-25 05:42:47.432912048 +0000 UTC m=+0.534041363 container remove eec073e494d9a9d843d3449bd2f51dbdafb3543f8bea40abe1ed1e6d9cf772f6 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, name=centos-stream, GIT_BRANCH=HEAD, release=754, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, version=8, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, distribution-scope=public, io.buildah.version=1.19.8, architecture=x86_64, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.display-name=CentOS Stream 8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-05-25T05:42:48.057 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:47 smithi088 podman[145042]: 2024-05-25 05:42:47.697863203 +0000 UTC m=+0.016981330 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:42:48.057 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:47 smithi088 podman[145042]: 2024-05-25 05:42:47.826614994 +0000 UTC m=+0.145733158 container create 10bfd08c3035af4b96ecdaecd9a633879581c276df9206bbc53acf3e0b63d69e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.vendor=CentOS, ceph=True, org.label-schema.build-date=20240521) 2024-05-25T05:42:48.350 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:48 smithi088 podman[145042]: 2024-05-25 05:42:48.061653902 +0000 UTC m=+0.380772046 container init 10bfd08c3035af4b96ecdaecd9a633879581c276df9206bbc53acf3e0b63d69e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_CLEAN=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, ceph=True, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:42:48.351 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:48 smithi088 podman[145042]: 2024-05-25 05:42:48.065312544 +0000 UTC m=+0.384430667 container start 10bfd08c3035af4b96ecdaecd9a633879581c276df9206bbc53acf3e0b63d69e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, RELEASE=squid-ea0684c, org.label-schema.schema-version=1.0) 2024-05-25T05:42:48.351 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:48 smithi088 podman[145042]: 2024-05-25 05:42:48.186176824 +0000 UTC m=+0.505294952 container attach 10bfd08c3035af4b96ecdaecd9a633879581c276df9206bbc53acf3e0b63d69e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD) 2024-05-25T05:42:48.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:48 smithi136 ceph-mon[113230]: osdmap e116: 8 total, 7 up, 8 in 2024-05-25T05:42:48.722 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:48 smithi088 ceph-mon[135492]: osdmap e116: 8 total, 7 up, 8 in 2024-05-25T05:42:48.722 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:48 smithi088 ceph-mon[140333]: osdmap e116: 8 total, 7 up, 8 in 2024-05-25T05:42:48.723 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:48 smithi088 podman[145042]: 2024-05-25 05:42:48.357718373 +0000 UTC m=+0.676836502 container died 10bfd08c3035af4b96ecdaecd9a633879581c276df9206bbc53acf3e0b63d69e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, ceph=True, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-25T05:42:49.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 podman[145068]: 2024-05-25 05:42:49.031606946 +0000 UTC m=+0.662579858 container remove 10bfd08c3035af4b96ecdaecd9a633879581c276df9206bbc53acf3e0b63d69e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-25T05:42:49.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-25T05:42:49.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 systemd[1]: Stopped Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:42:49.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.0.service: Consumed 14.481s CPU time. 2024-05-25T05:42:49.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 systemd[1]: Starting Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:42:49.611 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:49 smithi088 ceph-mon[135492]: pgmap v64: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:49.611 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:49 smithi088 ceph-mon[140333]: pgmap v64: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:49.611 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 podman[145168]: 2024-05-25 05:42:49.385142559 +0000 UTC m=+0.017023225 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:42:49.611 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 podman[145168]: 2024-05-25 05:42:49.499629669 +0000 UTC m=+0.131510320 container create d3e53cb1ee3bc57210cda3c3b6d314e6ca5292d2882d74ee28622b89be95bfbe (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093) 2024-05-25T05:42:49.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:49 smithi136 ceph-mon[113230]: pgmap v64: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:42:50.057 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 podman[145168]: 2024-05-25 05:42:49.752306568 +0000 UTC m=+0.384187236 container init d3e53cb1ee3bc57210cda3c3b6d314e6ca5292d2882d74ee28622b89be95bfbe (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, ceph=True, RELEASE=squid-ea0684c, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0) 2024-05-25T05:42:50.057 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 podman[145168]: 2024-05-25 05:42:49.755801958 +0000 UTC m=+0.387682619 container start d3e53cb1ee3bc57210cda3c3b6d314e6ca5292d2882d74ee28622b89be95bfbe (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, ceph=True) 2024-05-25T05:42:50.057 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:49 smithi088 podman[145168]: 2024-05-25 05:42:49.835322298 +0000 UTC m=+0.467202966 container attach d3e53cb1ee3bc57210cda3c3b6d314e6ca5292d2882d74ee28622b89be95bfbe (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ea0684c, ceph=True) 2024-05-25T05:42:50.501 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-05-25T05:42:50.501 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [7, 0]}]: dispatch 2024-05-25T05:42:50.501 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]: dispatch 2024-05-25T05:42:50.501 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.c", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.501 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.d", "id": [5, 6]}]: dispatch 2024-05-25T05:42:50.501 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]: dispatch 2024-05-25T05:42:50.501 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.15", "id": [7, 0]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1b", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1e", "id": [5, 0]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1f", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [7, 0]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.c", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.502 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.d", "id": [5, 6]}]: dispatch 2024-05-25T05:42:50.503 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]: dispatch 2024-05-25T05:42:50.503 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.15", "id": [7, 0]}]: dispatch 2024-05-25T05:42:50.503 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1b", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.503 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1e", "id": [5, 0]}]: dispatch 2024-05-25T05:42:50.503 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1f", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.503 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:50.503 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:50.503 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[145183]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:42:50.503 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[145183]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-25T05:42:50.503 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 bash[145168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:42:50.503 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 bash[145168]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-25T05:42:50.503 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 bash[145168]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-25T05:42:50.503 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 bash[145168]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 bash[145168]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 bash[145168]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 bash[145168]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[145183]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[145183]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[145183]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[145183]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[145183]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-25T05:42:50.504 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:50 smithi088 podman[145168]: 2024-05-25 05:42:50.232479315 +0000 UTC m=+0.864359972 container died d3e53cb1ee3bc57210cda3c3b6d314e6ca5292d2882d74ee28622b89be95bfbe (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-ea0684c, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-25T05:42:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [7, 0]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.c", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.d", "id": [5, 6]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.15", "id": [7, 0]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1b", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1e", "id": [5, 0]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1f", "id": [3, 0]}]: dispatch 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:42:51.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 podman[145308]: 2024-05-25 05:42:51.00663413 +0000 UTC m=+0.768563584 container remove d3e53cb1ee3bc57210cda3c3b6d314e6ca5292d2882d74ee28622b89be95bfbe (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, ceph=True, GIT_CLEAN=True, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux ) 2024-05-25T05:42:51.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 podman[145366]: 2024-05-25 05:42:51.122589057 +0000 UTC m=+0.016945126 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:42:51.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 podman[145366]: 2024-05-25 05:42:51.224140227 +0000 UTC m=+0.118496340 container create c25e177d6a56d175993de17a0cfb3e0add77b2312143aa5ab1801247213816d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , ceph=True, CEPH_POINT_RELEASE=, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.license=GPLv2, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS) 2024-05-25T05:42:51.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: pgmap v65: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [7, 0]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.c", "id": [3, 0]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.d", "id": [5, 6]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.15", "id": [7, 0]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1b", "id": [3, 0]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1e", "id": [5, 0]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1f", "id": [3, 0]}]': finished 2024-05-25T05:42:51.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:51 smithi136 ceph-mon[113230]: osdmap e117: 8 total, 7 up, 8 in 2024-05-25T05:42:51.765 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: pgmap v65: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-25T05:42:51.766 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]': finished 2024-05-25T05:42:51.766 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [7, 0]}]': finished 2024-05-25T05:42:51.766 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]': finished 2024-05-25T05:42:51.766 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.c", "id": [3, 0]}]': finished 2024-05-25T05:42:51.766 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.d", "id": [5, 6]}]': finished 2024-05-25T05:42:51.766 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]': finished 2024-05-25T05:42:51.767 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.15", "id": [7, 0]}]': finished 2024-05-25T05:42:51.767 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1b", "id": [3, 0]}]': finished 2024-05-25T05:42:51.767 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1e", "id": [5, 0]}]': finished 2024-05-25T05:42:51.767 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1f", "id": [3, 0]}]': finished 2024-05-25T05:42:51.767 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[135492]: osdmap e117: 8 total, 7 up, 8 in 2024-05-25T05:42:51.768 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: pgmap v65: 161 pgs: 21 stale+active+clean, 140 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 639 B/s rd, 0 op/s 2024-05-25T05:42:51.768 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.6", "id": [5, 0]}]': finished 2024-05-25T05:42:51.768 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.9", "id": [7, 0]}]': finished 2024-05-25T05:42:51.768 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "5.10", "id": [4, 2]}]': finished 2024-05-25T05:42:51.768 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.c", "id": [3, 0]}]': finished 2024-05-25T05:42:51.769 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.d", "id": [5, 6]}]': finished 2024-05-25T05:42:51.769 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.11", "id": [3, 1]}]': finished 2024-05-25T05:42:51.769 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.15", "id": [7, 0]}]': finished 2024-05-25T05:42:51.769 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1b", "id": [3, 0]}]': finished 2024-05-25T05:42:51.769 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1e", "id": [5, 0]}]': finished 2024-05-25T05:42:51.769 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "osd pg-upmap-items", "format": "json", "pgid": "6.1f", "id": [3, 0]}]': finished 2024-05-25T05:42:51.770 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:51 smithi088 ceph-mon[140333]: osdmap e117: 8 total, 7 up, 8 in 2024-05-25T05:42:51.770 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 podman[145366]: 2024-05-25 05:42:51.460139947 +0000 UTC m=+0.354496020 container init c25e177d6a56d175993de17a0cfb3e0add77b2312143aa5ab1801247213816d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ea0684c, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, ceph=True, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-25T05:42:51.770 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 podman[145366]: 2024-05-25 05:42:51.463474334 +0000 UTC m=+0.357830403 container start c25e177d6a56d175993de17a0cfb3e0add77b2312143aa5ab1801247213816d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, org.label-schema.license=GPLv2, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, RELEASE=squid-ea0684c, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-25T05:42:51.770 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 ceph-osd[145385]: -- 172.21.15.88:0/772982378 <== mon.1 v2:172.21.15.88:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55e0424c9680 con 0x55e042493400 2024-05-25T05:42:51.770 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 bash[145366]: c25e177d6a56d175993de17a0cfb3e0add77b2312143aa5ab1801247213816d8 2024-05-25T05:42:51.771 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:51 smithi088 systemd[1]: Started Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:42:52.056 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:52 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[145380]: 2024-05-25T05:42:52.006+0000 7f11cdee07c0 -1 Falling back to public interface 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: osdmap e118: 8 total, 7 up, 8 in 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.783 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.784 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: osdmap e118: 8 total, 7 up, 8 in 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.786 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:52 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:42:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: osdmap e118: 8 total, 7 up, 8 in 2024-05-25T05:42:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:52.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:52 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: pgmap v68: 161 pgs: 8 peering, 20 active+undersized+degraded, 36 active+undersized, 97 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%) 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: osdmap e119: 8 total, 7 up, 8 in 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Health check failed: Reduced data availability: 4 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Health check failed: Degraded data redundancy: 76/723 objects degraded (10.512%), 20 pgs degraded (PG_DEGRADED) 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.558 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: pgmap v68: 161 pgs: 8 peering, 20 active+undersized+degraded, 36 active+undersized, 97 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%) 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: osdmap e119: 8 total, 7 up, 8 in 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Health check failed: Reduced data availability: 4 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Health check failed: Degraded data redundancy: 76/723 objects degraded (10.512%), 20 pgs degraded (PG_DEGRADED) 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.562 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.565 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.567 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:53 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: pgmap v68: 161 pgs: 8 peering, 20 active+undersized+degraded, 36 active+undersized, 97 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%) 2024-05-25T05:42:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: osdmap e119: 8 total, 7 up, 8 in 2024-05-25T05:42:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Health check failed: Reduced data availability: 4 pgs inactive, 5 pgs peering (PG_AVAILABILITY) 2024-05-25T05:42:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Health check failed: Degraded data redundancy: 76/723 objects degraded (10.512%), 20 pgs degraded (PG_DEGRADED) 2024-05-25T05:42:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.890 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:53.891 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:53 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.488 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:42:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:42:54] "GET /metrics HTTP/1.1" 200 37996 "" "Prometheus/2.43.0" 2024-05-25T05:42:54.489 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.489 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.489 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.490 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.491 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.492 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.493 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.494 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.495 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.496 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.497 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.498 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.499 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.500 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:54 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:54.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:54 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.056 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[145380]: 2024-05-25T05:42:54.744+0000 7f11cdee07c0 -1 osd.0 0 read_superblock omap replica is missing. 2024-05-25T05:42:55.056 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[145380]: 2024-05-25T05:42:54.774+0000 7f11cdee07c0 -1 osd.0 114 log_to_monitors true 2024-05-25T05:42:55.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: pgmap v70: 161 pgs: 8 peering, 20 active+undersized+degraded, 36 active+undersized, 97 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%) 2024-05-25T05:42:55.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.652 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.653 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.654 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: pgmap v70: 161 pgs: 8 peering, 20 active+undersized+degraded, 36 active+undersized, 97 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%) 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.655 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.656 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.657 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.658 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.659 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.660 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.661 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.662 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:55 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: pgmap v70: 161 pgs: 8 peering, 20 active+undersized+degraded, 36 active+undersized, 97 active+clean; 585 KiB data, 100 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%) 2024-05-25T05:42:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:55.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:55 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:55.927 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:42:55 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[145380]: 2024-05-25T05:42:55.708+0000 7f11bf337700 -1 osd.0 114 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:42:56.670 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.670 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.670 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.671 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.671 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.671 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.671 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.671 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.671 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.673 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.674 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.675 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.675 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.675 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.675 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:42:56.675 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: osdmap e120: 8 total, 7 up, 8 in 2024-05-25T05:42:56.675 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:42:56.676 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.676 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.676 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.676 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.676 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.676 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.677 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.678 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: osdmap e120: 8 total, 7 up, 8 in 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.679 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.680 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.680 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.680 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.680 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.680 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.680 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.681 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.682 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.683 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.684 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.685 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:56 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:56.738 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:42:56.739 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: osdmap e120: 8 total, 7 up, 8 in 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.740 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:56.741 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:56.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:56.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:56.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:56.742 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:56 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.782 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: pgmap v71: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:42:57.782 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.782 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.782 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.782 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.782 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 5 pgs peering) 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.783 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486] boot 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: osdmap e121: 8 total, 8 up, 8 in 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.784 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: pgmap v71: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 5 pgs peering) 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.785 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486] boot 2024-05-25T05:42:57.786 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: osdmap e121: 8 total, 8 up, 8 in 2024-05-25T05:42:57.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:42:57.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.787 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.787 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.788 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.789 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.790 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.791 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.792 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.793 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.793 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:57 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: pgmap v71: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 101 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.796 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 4 pgs inactive, 5 pgs peering) 2024-05-25T05:42:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.797 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.798 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: osd.0 [v2:172.21.15.88:6802/64026486,v1:172.21.15.88:6803/64026486] boot 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: osdmap e121: 8 total, 8 up, 8 in 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.799 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.800 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.801 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:57.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:57.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:57.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:57.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:57.802 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:57 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.672 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.673 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: osdmap e122: 8 total, 8 up, 8 in 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.674 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.675 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.676 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:58 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: osdmap e122: 8 total, 8 up, 8 in 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.810 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.811 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: osdmap e122: 8 total, 8 up, 8 in 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.812 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.813 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.814 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.815 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:58.816 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:58 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: pgmap v74: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:42:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.558 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: osdmap e123: 8 total, 8 up, 8 in 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.559 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.560 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.561 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.562 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: pgmap v74: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.563 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.564 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: osdmap e123: 8 total, 8 up, 8 in 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.565 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.566 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.566 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.567 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.568 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.569 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:42:59 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: pgmap v74: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 682 B/s rd, 0 op/s; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: osdmap e123: 8 total, 8 up, 8 in 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:42:59.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:42:59.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:42:59.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:42:59.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:42:59.640 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:42:59 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: pgmap v77: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.636 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.637 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:43:00.638 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:43:00.639 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:00 smithi136 ceph-mon[113230]: Upgrade: osd.0 is safe to restart 2024-05-25T05:43:00.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: pgmap v77: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:43:00.743 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.744 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.745 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: pgmap v77: 161 pgs: 9 active+clean+remapped, 20 active+undersized+degraded, 36 active+undersized, 96 active+clean; 585 KiB data, 116 MiB used, 715 GiB / 715 GiB avail; 76/723 objects degraded (10.512%); 1/723 objects misplaced (0.138%) 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.746 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.747 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.748 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:43:00.749 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[135492]: Upgrade: osd.0 is safe to restart 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.750 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: from='mon.0 -' entity='mon.' cmd=[{"prefix": "osd ok-to-stop", "ids": ["0"], "max": 16}]: dispatch 2024-05-25T05:43:00.751 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:00 smithi088 ceph-mon[140333]: Upgrade: osd.0 is safe to restart 2024-05-25T05:43:01.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:01 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:01.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:01 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:01.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:01 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:02.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:02 smithi088 ceph-mon[135492]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 281 KiB/s rd, 282 op/s; 67 B/s, 0 objects/s recovering 2024-05-25T05:43:02.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:02 smithi088 ceph-mon[140333]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 281 KiB/s rd, 282 op/s; 67 B/s, 0 objects/s recovering 2024-05-25T05:43:02.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:02 smithi136 ceph-mon[113230]: pgmap v78: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 281 KiB/s rd, 282 op/s; 67 B/s, 0 objects/s recovering 2024-05-25T05:43:03.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:03 smithi088 ceph-mon[135492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/723 objects degraded (10.512%), 20 pgs degraded) 2024-05-25T05:43:03.711 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:03 smithi088 ceph-mon[135492]: Cluster is now healthy 2024-05-25T05:43:03.711 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:03 smithi088 ceph-mon[140333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/723 objects degraded (10.512%), 20 pgs degraded) 2024-05-25T05:43:03.711 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:03 smithi088 ceph-mon[140333]: Cluster is now healthy 2024-05-25T05:43:03.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:03 smithi136 ceph-mon[113230]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 76/723 objects degraded (10.512%), 20 pgs degraded) 2024-05-25T05:43:03.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:03 smithi136 ceph-mon[113230]: Cluster is now healthy 2024-05-25T05:43:04.428 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:04 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:43:04] "GET /metrics HTTP/1.1" 200 37996 "" "Prometheus/2.43.0" 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 239 KiB/s rd, 240 op/s; 57 B/s, 0 objects/s recovering 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 239 KiB/s rd, 240 op/s; 57 B/s, 0 objects/s recovering 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:05.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:04 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: pgmap v79: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 239 KiB/s rd, 240 op/s; 57 B/s, 0 objects/s recovering 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:05.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:04 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[140333]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 202 KiB/s rd, 203 op/s; 48 B/s, 0 objects/s recovering 2024-05-25T05:43:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[140333]: Upgrade: Updating osd.0 2024-05-25T05:43:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:43:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:07.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[140333]: Deploying daemon osd.0 on smithi088 2024-05-25T05:43:07.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[135492]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 202 KiB/s rd, 203 op/s; 48 B/s, 0 objects/s recovering 2024-05-25T05:43:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[135492]: Upgrade: Updating osd.0 2024-05-25T05:43:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:43:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:07.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:06 smithi088 ceph-mon[135492]: Deploying daemon osd.0 on smithi088 2024-05-25T05:43:07.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:06 smithi136 ceph-mon[113230]: pgmap v80: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 202 KiB/s rd, 203 op/s; 48 B/s, 0 objects/s recovering 2024-05-25T05:43:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:06 smithi136 ceph-mon[113230]: Upgrade: Updating osd.0 2024-05-25T05:43:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:06 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "osd.0"}]: dispatch 2024-05-25T05:43:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:06 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:07.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:06 smithi136 ceph-mon[113230]: Deploying daemon osd.0 on smithi088 2024-05-25T05:43:08.957 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:08 smithi088 ceph-mon[140333]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s rd, 167 op/s; 39 B/s, 0 objects/s recovering 2024-05-25T05:43:08.957 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:08 smithi088 ceph-mon[135492]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s rd, 167 op/s; 39 B/s, 0 objects/s recovering 2024-05-25T05:43:09.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:08 smithi136 ceph-mon[113230]: pgmap v81: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 166 KiB/s rd, 167 op/s; 39 B/s, 0 objects/s recovering 2024-05-25T05:43:09.306 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:09 smithi088 systemd[1]: Stopping Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:43:09.708 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[145380]: 2024-05-25T05:43:09.422+0000 7f11c4546700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:43:09.708 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[145380]: 2024-05-25T05:43:09.422+0000 7f11c4546700 -1 osd.0 123 *** Got signal Terminated *** 2024-05-25T05:43:09.708 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:09 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[145380]: 2024-05-25T05:43:09.422+0000 7f11c4546700 -1 osd.0 123 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:43:10.036 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:09 smithi088 ceph-mon[140333]: osd.0 marked itself down and dead 2024-05-25T05:43:10.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:09 smithi088 ceph-mon[135492]: osd.0 marked itself down and dead 2024-05-25T05:43:10.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:09 smithi136 ceph-mon[113230]: osd.0 marked itself down and dead 2024-05-25T05:43:10.306 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:10 smithi088 podman[149493]: 2024-05-25 05:43:10.03723395 +0000 UTC m=+0.741550273 container died c25e177d6a56d175993de17a0cfb3e0add77b2312143aa5ab1801247213816d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, CEPH_POINT_RELEASE=, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, RELEASE=squid-ea0684c, ceph=True, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-25T05:43:10.679 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:10 smithi088 podman[149493]: 2024-05-25 05:43:10.412323421 +0000 UTC m=+1.116639745 container cleanup c25e177d6a56d175993de17a0cfb3e0add77b2312143aa5ab1801247213816d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.schema-version=1.0) 2024-05-25T05:43:10.680 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:10 smithi088 bash[149493]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0 2024-05-25T05:43:11.037 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:10 smithi088 ceph-mon[140333]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 150 KiB/s rd, 151 op/s; 36 B/s, 0 objects/s recovering 2024-05-25T05:43:11.037 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:10 smithi088 ceph-mon[140333]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-25T05:43:11.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:10 smithi088 ceph-mon[140333]: osdmap e124: 8 total, 7 up, 8 in 2024-05-25T05:43:11.038 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:10 smithi088 podman[149510]: 2024-05-25 05:43:10.680245085 +0000 UTC m=+0.637102440 container remove c25e177d6a56d175993de17a0cfb3e0add77b2312143aa5ab1801247213816d8 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-25T05:43:11.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:10 smithi088 ceph-mon[135492]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 150 KiB/s rd, 151 op/s; 36 B/s, 0 objects/s recovering 2024-05-25T05:43:11.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:10 smithi088 ceph-mon[135492]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-25T05:43:11.038 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:10 smithi088 ceph-mon[135492]: osdmap e124: 8 total, 7 up, 8 in 2024-05-25T05:43:11.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:10 smithi136 ceph-mon[113230]: pgmap v82: 161 pgs: 161 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 150 KiB/s rd, 151 op/s; 36 B/s, 0 objects/s recovering 2024-05-25T05:43:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:10 smithi136 ceph-mon[113230]: Health check failed: 1 osds down (OSD_DOWN) 2024-05-25T05:43:11.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:10 smithi136 ceph-mon[113230]: osdmap e124: 8 total, 7 up, 8 in 2024-05-25T05:43:11.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:11 smithi088 podman[149598]: 2024-05-25 05:43:10.941082668 +0000 UTC m=+0.018252577 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:43:11.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:11 smithi088 podman[149598]: 2024-05-25 05:43:11.039550234 +0000 UTC m=+0.116720167 container create 1334c80910df75264941569bd0a4f041ba8ba8dbc297873ea40be044a9781a2e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240521) 2024-05-25T05:43:11.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:11 smithi088 podman[149598]: 2024-05-25 05:43:11.259025715 +0000 UTC m=+0.336195600 container init 1334c80910df75264941569bd0a4f041ba8ba8dbc297873ea40be044a9781a2e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, ceph=True, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5) 2024-05-25T05:43:11.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:11 smithi088 podman[149598]: 2024-05-25 05:43:11.262206446 +0000 UTC m=+0.339376338 container start 1334c80910df75264941569bd0a4f041ba8ba8dbc297873ea40be044a9781a2e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_CLEAN=True, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0) 2024-05-25T05:43:11.723 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:11 smithi088 podman[149598]: 2024-05-25 05:43:11.3338504 +0000 UTC m=+0.411020291 container attach 1334c80910df75264941569bd0a4f041ba8ba8dbc297873ea40be044a9781a2e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_CLEAN=True, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True) 2024-05-25T05:43:11.806 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:11 smithi088 podman[149598]: 2024-05-25 05:43:11.557497484 +0000 UTC m=+0.634667376 container died 1334c80910df75264941569bd0a4f041ba8ba8dbc297873ea40be044a9781a2e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, ceph=True, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-25T05:43:12.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:11 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:12.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:11 smithi088 ceph-mon[140333]: osdmap e125: 8 total, 7 up, 8 in 2024-05-25T05:43:12.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:11 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:12.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:11 smithi088 ceph-mon[135492]: osdmap e125: 8 total, 7 up, 8 in 2024-05-25T05:43:12.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:11 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:12.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:11 smithi136 ceph-mon[113230]: osdmap e125: 8 total, 7 up, 8 in 2024-05-25T05:43:12.285 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:43:12.557 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 podman[149623]: 2024-05-25 05:43:12.262692446 +0000 UTC m=+0.699332687 container remove 1334c80910df75264941569bd0a4f041ba8ba8dbc297873ea40be044a9781a2e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, RELEASE=squid-ea0684c, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , org.label-schema.vendor=CentOS, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_CLEAN=True, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=) 2024-05-25T05:43:12.557 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.0.service: Deactivated successfully. 2024-05-25T05:43:12.557 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 systemd[1]: Stopped Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:43:12.557 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.0.service: Consumed 1.839s CPU time. 2024-05-25T05:43:12.557 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 systemd[1]: Starting Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:43:12.977 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:12 smithi088 ceph-mon[135492]: pgmap v85: 161 pgs: 65 peering, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:12.977 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:12 smithi088 ceph-mon[135492]: Health check failed: Reduced data availability: 13 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-05-25T05:43:12.977 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:12 smithi088 ceph-mon[135492]: from='client.64216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:12.978 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:12 smithi088 ceph-mon[140333]: pgmap v85: 161 pgs: 65 peering, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:12.978 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:12 smithi088 ceph-mon[140333]: Health check failed: Reduced data availability: 13 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-05-25T05:43:12.978 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:12 smithi088 ceph-mon[140333]: from='client.64216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:12.978 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 podman[149770]: 2024-05-25 05:43:12.618253778 +0000 UTC m=+0.017192777 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:43:12.978 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 podman[149770]: 2024-05-25 05:43:12.738736549 +0000 UTC m=+0.137675520 container create a9b277c05428ff2533ae675347fd6a74674da04fd33fc1a7b5c8c1ca4b874ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, org.label-schema.schema-version=1.0, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_REPO=git@github.com:ceph/ceph-container.git, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, RELEASE=squid-ea0684c, org.label-schema.build-date=20240521, GIT_CLEAN=True, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS) 2024-05-25T05:43:12.978 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 8s ago 34m - - 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 14s ago 34m - - 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (5m) 8s ago 29m 26.8M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (4m) 14s ago 28m 78.0M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (7m) 8s ago 28m 63.9M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (7m) 14s ago 33m 452M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (18m) 8s ago 35m 516M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (2m) 8s ago 35m 46.1M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 a339af319c03 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (3m) 14s ago 34m 45.0M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (106s) 8s ago 34m 35.2M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 4ba25386cda9 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (6m) 8s ago 30m 15.4M - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (6m) 14s ago 29m 15.0M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (21s) 8s ago 33m 42.6M 4096M 19.0.0-2843-gea0684c0 f9a9809cafd6 c25e177d6a56 2024-05-25T05:43:12.979 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (33m) 8s ago 33m 57.0M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (32m) 8s ago 32m 52.5M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (32m) 8s ago 32m 58.8M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (32m) 14s ago 32m 57.6M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (31m) 14s ago 31m 54.1M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (31m) 14s ago 31m 55.5M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (30m) 14s ago 30m 56.7M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (5m) 14s ago 30m 69.9M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (28m) 8s ago 28m 78.9M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:43:12.980 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (28m) 14s ago 28m 80.4M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:43:13.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:12 smithi136 ceph-mon[113230]: pgmap v85: 161 pgs: 65 peering, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:13.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:12 smithi136 ceph-mon[113230]: Health check failed: Reduced data availability: 13 pgs inactive, 13 pgs peering (PG_AVAILABILITY) 2024-05-25T05:43:13.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:12 smithi136 ceph-mon[113230]: from='client.64216 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:13.306 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 podman[149770]: 2024-05-25 05:43:12.985188384 +0000 UTC m=+0.384127382 container init a9b277c05428ff2533ae675347fd6a74674da04fd33fc1a7b5c8c1ca4b874ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, ceph=True, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-25T05:43:13.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:12 smithi088 podman[149770]: 2024-05-25 05:43:12.988724393 +0000 UTC m=+0.387663373 container start a9b277c05428ff2533ae675347fd6a74674da04fd33fc1a7b5c8c1ca4b874ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, RELEASE=squid-ea0684c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, org.label-schema.schema-version=1.0, ceph=True) 2024-05-25T05:43:13.307 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 podman[149770]: 2024-05-25 05:43:13.066653704 +0000 UTC m=+0.465592689 container attach a9b277c05428ff2533ae675347fd6a74674da04fd33fc1a7b5c8c1ca4b874ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, ceph=True, RELEASE=squid-ea0684c, org.label-schema.vendor=CentOS, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-25T05:43:13.391 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "mon": { 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 3 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "mgr": { 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 2 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "osd": { 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 7 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "rgw": { 2024-05-25T05:43:13.392 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 2 2024-05-25T05:43:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: }, 2024-05-25T05:43:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: "overall": { 2024-05-25T05:43:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 17.2.0 (43e2e60a7559d3f46c9d53f1ca875fd499a1e35e) quincy (stable)": 9, 2024-05-25T05:43:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: "ceph version 19.0.0-2843-gea0684c0 (ea0684c08cbcf83f4af9930de2267b3563ac5f78) squid (rc)": 5 2024-05-25T05:43:13.393 INFO:teuthology.orchestra.run.smithi088.stdout: } 2024-05-25T05:43:13.393 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:43:13.729 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[149809]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[149809]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 bash[149770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 bash[149770]: Running command: /usr/bin/ceph-bluestore-tool prime-osd-dir --path /var/lib/ceph/osd/ceph-0 --no-mon-config --dev /dev/mapper/vg_nvme-lv_4 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 bash[149770]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 bash[149770]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 bash[149770]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 bash[149770]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 bash[149770]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[149809]: Running command: /usr/bin/chown -h ceph:ceph /dev/mapper/vg_nvme-lv_4 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[149809]: Running command: /usr/bin/chown -R ceph:ceph /dev/dm-3 2024-05-25T05:43:13.730 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[149809]: Running command: /usr/bin/ln -s /dev/mapper/vg_nvme-lv_4 /var/lib/ceph/osd/ceph-0/block 2024-05-25T05:43:13.731 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[149809]: Running command: /usr/bin/chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-05-25T05:43:13.731 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate[149809]: --> ceph-volume raw activate successful for osd ID: 0 2024-05-25T05:43:13.731 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:13 smithi088 podman[149770]: 2024-05-25 05:43:13.474273511 +0000 UTC m=+0.873212500 container died a9b277c05428ff2533ae675347fd6a74674da04fd33fc1a7b5c8c1ca4b874ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, org.label-schema.name=CentOS Stream 8 Base Image, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, GIT_CLEAN=True, org.label-schema.schema-version=1.0, ceph=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_BRANCH=HEAD, RELEASE=squid-ea0684c, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2) 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout:{ 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout: "target_image": "quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee", 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout: "in_progress": true, 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout: "which": "Upgrading daemons of type(s) osd. Upgrade limited to 2 daemons (1 remaining).", 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout: "services_complete": [], 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout: "progress": "1/8 daemons upgraded", 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout: "message": "Currently upgrading osd daemons", 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout: "is_paused": false 2024-05-25T05:43:13.745 INFO:teuthology.orchestra.run.smithi088.stdout:} 2024-05-25T05:43:14.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:13 smithi088 ceph-mon[135492]: from='client.64222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:13 smithi088 ceph-mon[135492]: from='client.54255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:13 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/2476376963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:13 smithi088 ceph-mon[140333]: from='client.64222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:13 smithi088 ceph-mon[140333]: from='client.54255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:13 smithi088 ceph-mon[140333]: from='client.? 172.21.15.88:0/2476376963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:14.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:13 smithi136 ceph-mon[113230]: from='client.64222 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:13 smithi136 ceph-mon[113230]: from='client.54255 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:13 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/2476376963' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:14.501 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:14 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:43:14] "GET /metrics HTTP/1.1" 200 38024 "" "Prometheus/2.43.0" 2024-05-25T05:43:14.502 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 podman[149954]: 2024-05-25 05:43:14.170587177 +0000 UTC m=+0.688264333 container remove a9b277c05428ff2533ae675347fd6a74674da04fd33fc1a7b5c8c1ca4b874ecc (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-activate, RELEASE=squid-ea0684c, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD) 2024-05-25T05:43:14.502 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 podman[150037]: 2024-05-25 05:43:14.284814154 +0000 UTC m=+0.018131397 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:43:14.502 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 podman[150037]: 2024-05-25 05:43:14.388339205 +0000 UTC m=+0.121656477 container create 09d713b7a8902e9926be6a3f27c7eaba0c1c54208a13329d0b08275802f594a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, RELEASE=squid-ea0684c, org.label-schema.license=GPLv2, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux ) 2024-05-25T05:43:14.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:14 smithi088 ceph-mon[140333]: pgmap v86: 161 pgs: 65 peering, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:14.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:14 smithi088 ceph-mon[140333]: from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:14 smithi088 ceph-mon[135492]: pgmap v86: 161 pgs: 65 peering, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:14.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:14 smithi088 ceph-mon[135492]: from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:14.807 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 podman[150037]: 2024-05-25 05:43:14.615550772 +0000 UTC m=+0.348868016 container init 09d713b7a8902e9926be6a3f27c7eaba0c1c54208a13329d0b08275802f594a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.license=GPLv2, ceph=True, maintainer=Guillaume Abrioux ) 2024-05-25T05:43:14.807 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 podman[150037]: 2024-05-25 05:43:14.618797866 +0000 UTC m=+0.352115097 container start 09d713b7a8902e9926be6a3f27c7eaba0c1c54208a13329d0b08275802f594a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, org.label-schema.vendor=CentOS, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, CEPH_POINT_RELEASE=, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-25T05:43:14.807 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 ceph-osd[150055]: -- 172.21.15.88:0/519426759 <== mon.1 v2:172.21.15.88:3301/0 4 ==== auth_reply(proto 2 0 (0) Success) ==== 194+0+0 (secure 0 0 0) 0x55fa57ee1680 con 0x55fa57eaac00 2024-05-25T05:43:14.807 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 bash[150037]: 09d713b7a8902e9926be6a3f27c7eaba0c1c54208a13329d0b08275802f594a9 2024-05-25T05:43:14.807 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:14 smithi088 systemd[1]: Started Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:43:15.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:14 smithi136 ceph-mon[113230]: pgmap v86: 161 pgs: 65 peering, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:15.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:14 smithi136 ceph-mon[113230]: from='client.64240 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:15.556 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:15 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[150051]: 2024-05-25T05:43:15.164+0000 7f1c5c5bd7c0 -1 Falling back to public interface 2024-05-25T05:43:16.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.036 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.037 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.038 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.039 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.040 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:15 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:16.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:16.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:16.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:16.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:15 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: pgmap v87: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 77/723 objects degraded (10.650%) 2024-05-25T05:43:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: pgmap v87: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 77/723 objects degraded (10.650%) 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Health check failed: Degraded data redundancy: 77/723 objects degraded (10.650%), 21 pgs degraded (PG_DEGRADED) 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 13 pgs inactive, 13 pgs peering) 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Health check failed: Degraded data redundancy: 77/723 objects degraded (10.650%), 21 pgs degraded (PG_DEGRADED) 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 13 pgs inactive, 13 pgs peering) 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.069 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:16 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: pgmap v87: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 77/723 objects degraded (10.650%) 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Health check failed: Degraded data redundancy: 77/723 objects degraded (10.650%), 21 pgs degraded (PG_DEGRADED) 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Health check cleared: PG_AVAILABILITY (was: Reduced data availability: 13 pgs inactive, 13 pgs peering) 2024-05-25T05:43:17.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:17.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:17.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:17.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:17.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:17.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:16 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.032 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:17 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[150051]: 2024-05-25T05:43:17.890+0000 7f1c5c5bd7c0 -1 osd.0 123 log_to_monitors true 2024-05-25T05:43:18.032 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.033 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.034 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.035 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.036 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.037 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.038 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.039 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.040 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:17 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.132 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.133 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:18.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:18.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:18.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:18.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:17 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: pgmap v88: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 77/723 objects degraded (10.650%) 2024-05-25T05:43:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:43:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:43:19.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: pgmap v88: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 77/723 objects degraded (10.650%) 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:18 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: pgmap v88: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 118 MiB used, 715 GiB / 715 GiB avail; 77/723 objects degraded (10.650%) 2024-05-25T05:43:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056]' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]: dispatch 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:18 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.556 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:43:19 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[150051]: 2024-05-25T05:43:19.271+0000 7f1c49a0c700 -1 osd.0 123 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-05-25T05:43:19.860 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: osdmap e126: 8 total, 7 up, 8 in 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.861 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='osd.0 ' entity='osd.0' 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.862 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: osdmap e126: 8 total, 7 up, 8 in 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.863 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='osd.0 ' entity='osd.0' 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.864 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.865 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.866 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.866 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:19.866 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.866 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.867 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.868 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.868 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.869 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.870 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.871 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:19 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='osd.0 ' entity='osd.0' cmd='[{"prefix": "osd crush set-device-class", "class": "ssd", "ids": ["0"]}]': finished 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: osdmap e126: 8 total, 7 up, 8 in 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056]' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='osd.0 ' entity='osd.0' cmd=[{"prefix": "osd crush create-or-move", "id": 0, "weight":0.0873, "args": ["host=smithi088", "root=default"]}]: dispatch 2024-05-25T05:43:19.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.886 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='osd.0 ' entity='osd.0' 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.887 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.888 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:19.889 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:19 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: pgmap v90: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 587 B/s rd, 0 op/s; 77/723 objects degraded (10.650%) 2024-05-25T05:43:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056] boot 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: osdmap e127: 8 total, 8 up, 8 in 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: pgmap v90: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 587 B/s rd, 0 op/s; 77/723 objects degraded (10.650%) 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056] boot 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: osdmap e127: 8 total, 8 up, 8 in 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:20 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: pgmap v90: 161 pgs: 21 active+undersized+degraded, 44 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 587 B/s rd, 0 op/s; 77/723 objects degraded (10.650%) 2024-05-25T05:43:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Health check cleared: OSD_DOWN (was: 1 osds down) 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: osd.0 [v2:172.21.15.88:6802/647852056,v1:172.21.15.88:6803/647852056] boot 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: osdmap e127: 8 total, 8 up, 8 in 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd metadata", "id": 0}]: dispatch 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:21.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:20 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: osdmap e128: 8 total, 8 up, 8 in 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: osdmap e128: 8 total, 8 up, 8 in 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:21 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: osdmap e128: 8 total, 8 up, 8 in 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:22.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:22.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:22.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:22.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:21 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: pgmap v93: 161 pgs: 39 peering, 8 active+undersized+degraded, 18 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 33/723 objects degraded (4.564%) 2024-05-25T05:43:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: Health check update: Degraded data redundancy: 33/723 objects degraded (4.564%), 8 pgs degraded (PG_DEGRADED) 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.060 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: pgmap v93: 161 pgs: 39 peering, 8 active+undersized+degraded, 18 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 33/723 objects degraded (4.564%) 2024-05-25T05:43:23.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: Health check update: Degraded data redundancy: 33/723 objects degraded (4.564%), 8 pgs degraded (PG_DEGRADED) 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:22 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: pgmap v93: 161 pgs: 39 peering, 8 active+undersized+degraded, 18 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 33/723 objects degraded (4.564%) 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: Health check update: Degraded data redundancy: 33/723 objects degraded (4.564%), 8 pgs degraded (PG_DEGRADED) 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:23.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:22 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.062 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.069 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.070 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.071 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.072 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:23 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:24.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:24.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:24.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:24.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:23 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:24.387 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:24 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:43:24] "GET /metrics HTTP/1.1" 200 37933 "" "Prometheus/2.43.0" 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: pgmap v94: 161 pgs: 39 peering, 8 active+undersized+degraded, 18 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 33/723 objects degraded (4.564%) 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: pgmap v94: 161 pgs: 39 peering, 8 active+undersized+degraded, 18 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 33/723 objects degraded (4.564%) 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.059 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.060 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.061 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: Upgrade: Finalizing container_image settings 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:43:25.062 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.063 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: Upgrade: Finalizing container_image settings 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:43:25.064 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:43:25.065 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:43:25.066 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.067 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.068 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:24 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: pgmap v94: 161 pgs: 39 peering, 8 active+undersized+degraded, 18 active+undersized, 96 active+clean; 585 KiB data, 119 MiB used, 715 GiB / 715 GiB avail; 33/723 objects degraded (4.564%) 2024-05-25T05:43:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.136 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Metadata not up to date on all hosts. Skipping non agent specs 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Upgrade: Setting container_image for all nvmeof 2024-05-25T05:43:25.137 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: Upgrade: Finalizing container_image settings 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mgr"}]': finished 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "mon"}]': finished 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.crash"}]': finished 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "osd"}]: dispatch 2024-05-25T05:43:25.138 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mds"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rgw"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.rbd-mirror"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.ceph-exporter"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.iscsi"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nfs"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix": "config rm", "name": "container_image", "who": "client.nvmeof"}]': finished 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.139 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config rm", "name": "container_image", "who": "mon"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd='[{"prefix":"config-key del","key":"mgr/cephadm/upgrade_state"}]': finished 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config dump", "format": "json"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "config generate-minimal-conf"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "auth get", "entity": "client.admin"}]: dispatch 2024-05-25T05:43:25.140 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:24 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:25.878 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:25 smithi088 ceph-mon[135492]: Upgrade: Complete! 2024-05-25T05:43:25.879 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:25 smithi088 ceph-mon[140333]: Upgrade: Complete! 2024-05-25T05:43:26.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:25 smithi136 ceph-mon[113230]: Upgrade: Complete! 2024-05-25T05:43:27.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:26 smithi088 ceph-mon[135492]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:27.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:26 smithi088 ceph-mon[135492]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/723 objects degraded (4.564%), 8 pgs degraded) 2024-05-25T05:43:27.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:26 smithi088 ceph-mon[135492]: Cluster is now healthy 2024-05-25T05:43:27.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:26 smithi088 ceph-mon[140333]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:27.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:26 smithi088 ceph-mon[140333]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/723 objects degraded (4.564%), 8 pgs degraded) 2024-05-25T05:43:27.057 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:26 smithi088 ceph-mon[140333]: Cluster is now healthy 2024-05-25T05:43:27.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:26 smithi136 ceph-mon[113230]: pgmap v95: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:26 smithi136 ceph-mon[113230]: Health check cleared: PG_DEGRADED (was: Degraded data redundancy: 33/723 objects degraded (4.564%), 8 pgs degraded) 2024-05-25T05:43:27.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:26 smithi136 ceph-mon[113230]: Cluster is now healthy 2024-05-25T05:43:29.095 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:28 smithi088 ceph-mon[135492]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:29.096 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:28 smithi088 ceph-mon[140333]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:29.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:28 smithi136 ceph-mon[113230]: pgmap v96: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[135492]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[140333]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:30.808 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:30 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:31.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:30 smithi136 ceph-mon[113230]: pgmap v97: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:31.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:30 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:32.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:31 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:32.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:31 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:32.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:31 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:33.056 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:32 smithi088 ceph-mon[140333]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:33.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:32 smithi088 ceph-mon[135492]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:33.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:32 smithi136 ceph-mon[113230]: pgmap v98: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:34.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:34 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:43:34] "GET /metrics HTTP/1.1" 200 37933 "" "Prometheus/2.43.0" 2024-05-25T05:43:35.056 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[135492]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:35.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:35.057 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:35.058 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:35.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[140333]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:35.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:35.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:35.058 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:34 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:35.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:34 smithi136 ceph-mon[113230]: pgmap v99: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail 2024-05-25T05:43:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:34 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:34 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:35.135 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:34 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:37.303 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:37 smithi136 ceph-mon[113230]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:43:37.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:37 smithi088 ceph-mon[140333]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:43:37.306 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:37 smithi088 ceph-mon[135492]: pgmap v100: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 341 B/s rd, 0 op/s 2024-05-25T05:43:39.306 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:39 smithi088 ceph-mon[140333]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:39.307 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:39 smithi088 ceph-mon[135492]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:39.307 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:39 smithi136 ceph-mon[113230]: pgmap v101: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:40.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:40 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.807 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:40 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:40.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:40 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:41.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:41 smithi136 ceph-mon[113230]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:41.809 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:41 smithi088 ceph-mon[140333]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:41.809 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:41 smithi088 ceph-mon[135492]: pgmap v102: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:42.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:42 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:42.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:42 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:42.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:42 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:43.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:43 smithi136 ceph-mon[113230]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:43.806 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:43 smithi088 ceph-mon[140333]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:43.807 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:43 smithi088 ceph-mon[135492]: pgmap v103: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:44.495 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:44 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:43:44] "GET /metrics HTTP/1.1" 200 38077 "" "Prometheus/2.43.0" 2024-05-25T05:43:44.897 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch ps' 2024-05-25T05:43:45.456 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:45 smithi088 ceph-mon[140333]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:45.456 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:45 smithi088 ceph-mon[140333]: from='client.64252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:45.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:45 smithi088 ceph-mon[135492]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:45.457 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:45 smithi088 ceph-mon[135492]: from='client.64252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:45.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:45 smithi136 ceph-mon[113230]: pgmap v104: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:45.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:45 smithi136 ceph-mon[113230]: from='client.64252 -' entity='client.admin' cmd=[{"prefix": "orch upgrade status", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:NAME HOST PORTS STATUS REFRESHED AGE MEM USE MEM LIM VERSION IMAGE ID CONTAINER ID 2024-05-25T05:43:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi088 smithi088 running 16s ago 35m - - 2024-05-25T05:43:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:agent.smithi136 smithi136 running 7s ago 35m - - 2024-05-25T05:43:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:alertmanager.a smithi088 *:9093,9094 running (5m) 16s ago 29m 26.8M - 0.25.0 c8568f914cd2 5a72ab1af946 2024-05-25T05:43:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:grafana.a smithi136 *:3000 running (4m) 7s ago 29m 79.0M - 9.4.12 2bacad6d85d8 6a7a56a667d5 2024-05-25T05:43:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:iscsi.foo.smithi088.khxvsc smithi088 running (8m) 16s ago 28m 64.0M - 3.5 e1d6a67b021e b00a081e10c1 2024-05-25T05:43:46.921 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.x smithi136 *:8443,9283,8765 running (7m) 7s ago 34m 452M - 19.0.0-2843-gea0684c0 f9a9809cafd6 92afd76e3ef8 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:mgr.y smithi088 *:8443,9283,8765 running (18m) 16s ago 36m 519M - 19.0.0-2843-gea0684c0 f9a9809cafd6 2bd3af4bc07f 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:mon.a smithi088 running (2m) 16s ago 36m 48.7M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 a339af319c03 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:mon.b smithi136 running (4m) 7s ago 34m 46.6M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 b80204e525b5 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:mon.c smithi088 running (2m) 16s ago 34m 37.9M 2048M 19.0.0-2843-gea0684c0 f9a9809cafd6 4ba25386cda9 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.a smithi088 *:9100 running (7m) 16s ago 30m 15.2M - 1.5.0 0da6a335fe13 b882d57e2d6e 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:node-exporter.b smithi136 *:9100 running (7m) 7s ago 30m 14.9M - 1.5.0 0da6a335fe13 c86191bd770a 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.0 smithi088 running (32s) 16s ago 34m 50.0M 4096M 19.0.0-2843-gea0684c0 f9a9809cafd6 09d713b7a890 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.1 smithi088 running (33m) 16s ago 33m 57.4M 4096M 17.2.0 e1d6a67b021e 4c22601512ad 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.2 smithi088 running (33m) 16s ago 33m 52.7M 4096M 17.2.0 e1d6a67b021e f9fa605a8ed9 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.3 smithi088 running (33m) 16s ago 32m 59.0M 4096M 17.2.0 e1d6a67b021e 6985caf6a798 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.4 smithi136 running (32m) 7s ago 32m 58.3M 4096M 17.2.0 e1d6a67b021e 54ac1ccc49c0 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.5 smithi136 running (32m) 7s ago 32m 53.9M 4096M 17.2.0 e1d6a67b021e c8648e2982d9 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.6 smithi136 running (31m) 7s ago 31m 56.2M 4096M 17.2.0 e1d6a67b021e 6e494205dc02 2024-05-25T05:43:46.922 INFO:teuthology.orchestra.run.smithi088.stdout:osd.7 smithi136 running (31m) 7s ago 31m 56.5M 4096M 17.2.0 e1d6a67b021e 22b8b2698fda 2024-05-25T05:43:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:prometheus.a smithi136 *:9095 running (6m) 7s ago 30m 69.9M - 2.43.0 a07b618ecd1d aea77ce696fa 2024-05-25T05:43:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi088.beqodg smithi088 *:8000 running (29m) 16s ago 29m 79.0M - 17.2.0 e1d6a67b021e 39bf995ed356 2024-05-25T05:43:46.923 INFO:teuthology.orchestra.run.smithi088.stdout:rgw.foo.smithi136.bfemvm smithi136 *:8000 running (29m) 7s ago 29m 80.5M - 17.2.0 e1d6a67b021e 7e7742f8f919 2024-05-25T05:43:47.467 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:47 smithi088 ceph-mon[140333]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:47.468 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:47 smithi088 ceph-mon[135492]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:47.491 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph versions | jq -e '"'"'.osd | length == 2'"'"'' 2024-05-25T05:43:47.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:47 smithi136 ceph-mon[113230]: pgmap v105: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:48.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:48 smithi088 ceph-mon[135492]: from='client.64258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:48.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:48 smithi088 ceph-mon[140333]: from='client.64258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:48.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:48 smithi136 ceph-mon[113230]: from='client.64258 -' entity='client.admin' cmd=[{"prefix": "orch ps", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:49.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:49 smithi088 ceph-mon[135492]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:49.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:49 smithi088 ceph-mon[140333]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:49.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:49 smithi136 ceph-mon[113230]: pgmap v106: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:50.549 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:50.549 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.549 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.549 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[140333]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.550 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:50.550 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.550 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.550 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:50 smithi088 ceph-mon[135492]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' cmd=[{"prefix": "osd blocklist ls", "format": "json"}]: dispatch 2024-05-25T05:43:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:50.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:50 smithi136 ceph-mon[113230]: from='mgr.44106 172.21.15.88:0/872170519' entity='mgr.y' 2024-05-25T05:43:51.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:51 smithi088 ceph-mon[140333]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:51.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:51 smithi088 ceph-mon[135492]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:51.689 INFO:teuthology.orchestra.run.smithi088.stdout:true 2024-05-25T05:43:51.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:51 smithi136 ceph-mon[113230]: pgmap v107: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:52.277 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c 'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e '"'"'.up_to_date | length == 7'"'"'' 2024-05-25T05:43:52.695 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:52 smithi088 ceph-mon[135492]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:52.696 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:52 smithi088 ceph-mon[135492]: from='client.? 172.21.15.88:0/619393916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:52.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:52 smithi088 ceph-mon[140333]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:52.696 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:52 smithi088 ceph-mon[140333]: from='client.? 172.21.15.88:0/619393916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:52.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:52 smithi136 ceph-mon[113230]: from='client.25414 -' entity='client.iscsi.foo.smithi088.khxvsc' cmd=[{"prefix": "service status", "format": "json"}]: dispatch 2024-05-25T05:43:52.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:52 smithi136 ceph-mon[113230]: from='client.? 172.21.15.88:0/619393916' entity='client.admin' cmd=[{"prefix": "versions"}]: dispatch 2024-05-25T05:43:53.534 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:53 smithi088 ceph-mon[140333]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:53.534 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:53 smithi088 ceph-mon[135492]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:53.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:53 smithi136 ceph-mon[113230]: pgmap v108: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:54.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:54 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: ::ffff:172.21.15.136 - - [25/May/2024:05:43:54] "GET /metrics HTTP/1.1" 200 38076 "" "Prometheus/2.43.0" 2024-05-25T05:43:55.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:55 smithi088 ceph-mon[140333]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:55.669 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:55 smithi088 ceph-mon[140333]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:55.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:55 smithi088 ceph-mon[135492]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:55.669 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:55 smithi088 ceph-mon[135492]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:55.884 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:55 smithi136 ceph-mon[113230]: pgmap v109: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 853 B/s rd, 0 op/s 2024-05-25T05:43:55.885 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:55 smithi136 ceph-mon[113230]: from='client.64270 -' entity='client.admin' cmd=[{"prefix": "orch upgrade check", "image": "quay.ceph.io/ceph-ci/ceph:ea0684c08cbcf83f4af9930de2267b3563ac5f78", "target": ["mon-mgr", ""]}]: dispatch 2024-05-25T05:43:56.549 INFO:teuthology.orchestra.run.smithi088.stdout:false 2024-05-25T05:43:57.216 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T05:43:57.217 ERROR:teuthology.run_tasks:Saw exception from tasks. Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_17c123e524b17eb0cf38bdb0a0ca89d80b36c131/qa/tasks/cephadm.py", line 1469, in shell _shell( File "/home/teuthworker/src/git.ceph.com_ceph_17c123e524b17eb0cf38bdb0a0ca89d80b36c131/qa/tasks/cephadm.py", line 110, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\'' 2024-05-25T05:43:57.399 ERROR:teuthology.util.sentry: Sentry event: https://sentry.ceph.com/organizations/ceph/?query=5b8124d3e25d4c248ec324ee00f1aa3f Traceback (most recent call last): File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 105, in run_tasks manager = run_one_task(taskname, ctx=ctx, config=config) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/run_tasks.py", line 83, in run_one_task return task(**kwargs) File "/home/teuthworker/src/git.ceph.com_ceph_17c123e524b17eb0cf38bdb0a0ca89d80b36c131/qa/tasks/cephadm.py", line 1469, in shell _shell( File "/home/teuthworker/src/git.ceph.com_ceph_17c123e524b17eb0cf38bdb0a0ca89d80b36c131/qa/tasks/cephadm.py", line 110, in _shell return remote.run( File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/remote.py", line 523, in run r = self._runner(client=self.ssh, name=self.shortname, **kwargs) File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 455, in run r.wait() File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 161, in wait self._raise_for_status() File "/home/teuthworker/src/git.ceph.com_teuthology_e7ae7580c417d6ab27fda98fecadca5d9f85d63e/teuthology/orchestra/run.py", line 181, in _raise_for_status raise CommandFailedError( teuthology.exceptions.CommandFailedError: Command failed on smithi088 with status 1: 'sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c \'ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \'"\'"\'.up_to_date | length == 7\'"\'"\'\'' 2024-05-25T05:43:57.401 DEBUG:teuthology.run_tasks:Unwinding manager cephadm 2024-05-25T05:43:57.410 INFO:tasks.cephadm:Teardown begin 2024-05-25T05:43:57.411 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-25T05:43:57.442 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:57 smithi088 ceph-mon[135492]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:57.443 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:57 smithi088 ceph-mon[140333]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:57.448 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-25T05:43:57.479 INFO:tasks.cephadm:Cleaning up testdir ceph.* files... 2024-05-25T05:43:57.479 DEBUG:teuthology.orchestra.run.smithi088:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-25T05:43:57.507 DEBUG:teuthology.orchestra.run.smithi136:> rm -f /home/ubuntu/cephtest/seed.ceph.conf /home/ubuntu/cephtest/ceph.pub 2024-05-25T05:43:57.534 INFO:tasks.cephadm:Stopping all daemons... 2024-05-25T05:43:57.535 INFO:tasks.cephadm.mon.a:Stopping mon.a... 2024-05-25T05:43:57.535 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a 2024-05-25T05:43:57.634 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:43:57 smithi136 ceph-mon[113230]: pgmap v110: 161 pgs: 161 active+clean; 585 KiB data, 124 MiB used, 715 GiB / 715 GiB avail; 1.2 KiB/s rd, 1 op/s 2024-05-25T05:43:57.806 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:57 smithi088 systemd[1]: Stopping Ceph mon.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:43:58.144 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[135488]: 2024-05-25T05:43:57.889+0000 7f8508f4c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.a -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:43:58.144 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a[135488]: 2024-05-25T05:43:57.889+0000 7f8508f4c700 -1 mon.a@0(leader) e4 *** Got Signal Terminated *** 2024-05-25T05:43:58.144 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:57 smithi088 podman[154930]: 2024-05-25 05:43:57.951735377 +0000 UTC m=+0.195432998 container died a339af319c03fa9b03749f7d071db6cb6c6db6d9d08d447f7b98d1ef8baaea1c (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, io.buildah.version=1.33.5, GIT_CLEAN=True, org.label-schema.build-date=20240521, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, RELEASE=squid-ea0684c, org.label-schema.name=CentOS Stream 8 Base Image, ceph=True, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git) 2024-05-25T05:43:58.145 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:43:57] ENGINE Bus STOPPING 2024-05-25T05:43:58.145 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:43:57] ENGINE HTTP Server cherrypy._cpwsgi_server.CPWSGIServer(('::', 9283)) shut down 2024-05-25T05:43:58.145 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:43:57] ENGINE Bus STOPPED 2024-05-25T05:43:58.145 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:57 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:43:57] ENGINE Bus STARTING 2024-05-25T05:43:58.145 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:43:58] ENGINE Serving on http://:::9283 2024-05-25T05:43:58.145 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:43:58 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: [25/May/2024:05:43:58] ENGINE Bus STARTED 2024-05-25T05:43:58.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:58 smithi088 podman[154930]: 2024-05-25 05:43:58.298895103 +0000 UTC m=+0.542592722 container cleanup a339af319c03fa9b03749f7d071db6cb6c6db6d9d08d447f7b98d1ef8baaea1c (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-ea0684c, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, ceph=True) 2024-05-25T05:43:58.557 INFO:journalctl@ceph.mon.a.smithi088.stdout:May 25 05:43:58 smithi088 bash[154930]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-a 2024-05-25T05:43:58.793 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.a.service' 2024-05-25T05:43:58.837 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:43:58.837 INFO:tasks.cephadm.mon.a:Stopped mon.a 2024-05-25T05:43:58.838 INFO:tasks.cephadm.mon.b:Stopping mon.c... 2024-05-25T05:43:58.838 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.c 2024-05-25T05:43:59.195 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:58 smithi088 systemd[1]: Stopping Ceph mon.c for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:43:59.556 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c[140328]: 2024-05-25T05:43:59.194+0000 7ff6c2c7c700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.c -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:43:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:59 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c[140328]: 2024-05-25T05:43:59.194+0000 7ff6c2c7c700 -1 mon.c@1(peon) e4 *** Got Signal Terminated *** 2024-05-25T05:43:59.557 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:59 smithi088 podman[155064]: 2024-05-25 05:43:59.358779194 +0000 UTC m=+0.293947542 container died 4ba25386cda91496f1514999de9f5147360f20fdb2a468e534664e544f564174 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, RELEASE=squid-ea0684c, org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, io.buildah.version=1.33.5, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.schema-version=1.0, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-25T05:43:59.996 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:59 smithi088 podman[155064]: 2024-05-25 05:43:59.720366143 +0000 UTC m=+0.655534471 container cleanup 4ba25386cda91496f1514999de9f5147360f20fdb2a468e534664e544f564174 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, org.label-schema.license=GPLv2, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ea0684c, io.buildah.version=1.33.5) 2024-05-25T05:43:59.996 INFO:journalctl@ceph.mon.c.smithi088.stdout:May 25 05:43:59 smithi088 bash[155064]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-c 2024-05-25T05:44:00.151 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.c.service' 2024-05-25T05:44:00.187 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:00.188 INFO:tasks.cephadm.mon.b:Stopped mon.c 2024-05-25T05:44:00.188 INFO:tasks.cephadm.mon.b:Stopping mon.b... 2024-05-25T05:44:00.188 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.b 2024-05-25T05:44:00.384 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:44:00 smithi136 systemd[1]: Stopping Ceph mon.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:44:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b[113214]: 2024-05-25T05:44:00.523+0000 7fbe65e26700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mon -n mon.b -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false --default-mon-cluster-log-to-file=false --default-mon-cluster-log-to-journald=true --default-mon-cluster-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:00.779 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:44:00 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b[113214]: 2024-05-25T05:44:00.524+0000 7fbe65e26700 -1 mon.b@2(peon) e4 *** Got Signal Terminated *** 2024-05-25T05:44:01.134 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:44:00 smithi136 podman[132573]: 2024-05-25 05:44:00.779658584 +0000 UTC m=+0.402471391 container died b80204e525b512e2b17049bc2874218d966056516722122a4e872a1dd693a705 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, org.label-schema.vendor=CentOS, GIT_CLEAN=True, ceph=True, CEPH_POINT_RELEASE=, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-ea0684c, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521) 2024-05-25T05:44:01.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:44:01 smithi136 podman[132573]: 2024-05-25 05:44:01.441934635 +0000 UTC m=+1.064747483 container cleanup b80204e525b512e2b17049bc2874218d966056516722122a4e872a1dd693a705 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b, maintainer=Guillaume Abrioux , RELEASE=squid-ea0684c, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, GIT_CLEAN=True) 2024-05-25T05:44:01.635 INFO:journalctl@ceph.mon.b.smithi136.stdout:May 25 05:44:01 smithi136 bash[132573]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mon-b 2024-05-25T05:44:01.869 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mon.b.service' 2024-05-25T05:44:01.917 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:01.918 INFO:tasks.cephadm.mon.b:Stopped mon.b 2024-05-25T05:44:01.918 INFO:tasks.cephadm.mgr.y:Stopping mgr.y... 2024-05-25T05:44:01.918 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y 2024-05-25T05:44:02.233 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:44:01 smithi088 systemd[1]: Stopping Ceph mgr.y for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:02.556 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:44:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:44:02.231+0000 7f1a34613700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-mgr -n mgr.y -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:02.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:44:02 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y[70720]: 2024-05-25T05:44:02.231+0000 7f1a34613700 -1 mgr handle_mgr_signal *** Got signal Terminated *** 2024-05-25T05:44:02.557 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:44:02 smithi088 podman[155258]: 2024-05-25 05:44:02.274090151 +0000 UTC m=+0.155244897 container died 2bd3af4bc07f072ac9ff4935ac9becf845626928c403956b13b1473e1300560d (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, org.label-schema.build-date=20240521, org.label-schema.name=CentOS Stream 8 Base Image, maintainer=Guillaume Abrioux , org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, RELEASE=squid-ea0684c, ceph=True, org.label-schema.license=GPLv2, GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS) 2024-05-25T05:44:02.992 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:44:02 smithi088 podman[155258]: 2024-05-25 05:44:02.724905265 +0000 UTC m=+0.606060011 container cleanup 2bd3af4bc07f072ac9ff4935ac9becf845626928c403956b13b1473e1300560d (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_CLEAN=True, maintainer=Guillaume Abrioux , RELEASE=squid-ea0684c, ceph=True, CEPH_POINT_RELEASE=) 2024-05-25T05:44:02.993 INFO:journalctl@ceph.mgr.y.smithi088.stdout:May 25 05:44:02 smithi088 bash[155258]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-y 2024-05-25T05:44:03.140 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.y.service' 2024-05-25T05:44:03.178 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:03.178 INFO:tasks.cephadm.mgr.y:Stopped mgr.y 2024-05-25T05:44:03.178 INFO:tasks.cephadm.mgr.x:Stopping mgr.x... 2024-05-25T05:44:03.179 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x 2024-05-25T05:44:03.493 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:44:03 smithi136 systemd[1]: Stopping Ceph mgr.x for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:03.772 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:44:03 smithi136 podman[132693]: 2024-05-25 05:44:03.49430777 +0000 UTC m=+0.120922947 container died 92afd76e3ef8c138a5fc90bd5ba3243e62e6f7f9323caeee80ad0052135141b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, io.buildah.version=1.33.5, RELEASE=squid-ea0684c, ceph=True, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_CLEAN=True, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.build-date=20240521, org.label-schema.vendor=CentOS, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2, org.label-schema.name=CentOS Stream 8 Base Image) 2024-05-25T05:44:04.134 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:44:03 smithi136 podman[132693]: 2024-05-25 05:44:03.946725861 +0000 UTC m=+0.573341038 container cleanup 92afd76e3ef8c138a5fc90bd5ba3243e62e6f7f9323caeee80ad0052135141b1 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD, org.label-schema.schema-version=1.0, CEPH_POINT_RELEASE=, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, org.label-schema.build-date=20240521, maintainer=Guillaume Abrioux , RELEASE=squid-ea0684c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_CLEAN=True, ceph=True, org.label-schema.license=GPLv2) 2024-05-25T05:44:04.135 INFO:journalctl@ceph.mgr.x.smithi136.stdout:May 25 05:44:03 smithi136 bash[132693]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-mgr-x 2024-05-25T05:44:04.412 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@mgr.x.service' 2024-05-25T05:44:04.447 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:04.447 INFO:tasks.cephadm.mgr.x:Stopped mgr.x 2024-05-25T05:44:04.447 INFO:tasks.cephadm.osd.0:Stopping osd.0... 2024-05-25T05:44:04.448 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.0 2024-05-25T05:44:04.556 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:04 smithi088 systemd[1]: Stopping Ceph osd.0 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:05.801 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[150051]: 2024-05-25T05:44:05.501+0000 7f1c52c23700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.0 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:05.801 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[150051]: 2024-05-25T05:44:05.501+0000 7f1c52c23700 -1 osd.0 128 *** Got signal Terminated *** 2024-05-25T05:44:05.802 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:05 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0[150051]: 2024-05-25T05:44:05.501+0000 7f1c52c23700 -1 osd.0 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:44:11.203 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:10 smithi088 podman[155681]: 2024-05-25 05:44:10.930228708 +0000 UTC m=+5.515075409 container died 09d713b7a8902e9926be6a3f27c7eaba0c1c54208a13329d0b08275802f594a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, RELEASE=squid-ea0684c, org.label-schema.name=CentOS Stream 8 Base Image, GIT_BRANCH=HEAD, ceph=True, GIT_CLEAN=True, org.label-schema.build-date=20240521, org.label-schema.schema-version=1.0, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux , CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-25T05:44:11.553 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:11 smithi088 podman[155681]: 2024-05-25 05:44:11.302463474 +0000 UTC m=+5.887310177 container cleanup 09d713b7a8902e9926be6a3f27c7eaba0c1c54208a13329d0b08275802f594a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, org.label-schema.build-date=20240521, CEPH_POINT_RELEASE=, io.buildah.version=1.33.5, ceph=True, GIT_BRANCH=HEAD, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.schema-version=1.0, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2) 2024-05-25T05:44:11.553 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:11 smithi088 bash[155681]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0 2024-05-25T05:44:11.806 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:11 smithi088 podman[156065]: 2024-05-25 05:44:11.553721211 +0000 UTC m=+0.620360871 container remove 09d713b7a8902e9926be6a3f27c7eaba0c1c54208a13329d0b08275802f594a9 (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.name=CentOS Stream 8 Base Image, org.label-schema.build-date=20240521, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-ea0684c, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , org.label-schema.license=GPLv2) 2024-05-25T05:44:12.173 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:11 smithi088 podman[156158]: 2024-05-25 05:44:11.824029523 +0000 UTC m=+0.017222733 image pull f9a9809cafd60a51ac0d352bb3d2d070ab25f705b0418cbd27290854c20186a2 quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee 2024-05-25T05:44:12.173 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:11 smithi088 podman[156158]: 2024-05-25 05:44:11.929727233 +0000 UTC m=+0.122920424 container create 92569f1ea1a9a577780d1116125ce1babf3578d7324356602504a52a16723a9e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240521, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=, ceph=True, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, RELEASE=squid-ea0684c, org.label-schema.name=CentOS Stream 8 Base Image, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, maintainer=Guillaume Abrioux , GIT_CLEAN=True, org.label-schema.license=GPLv2, org.label-schema.vendor=CentOS) 2024-05-25T05:44:12.557 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:12 smithi088 podman[156158]: 2024-05-25 05:44:12.173984252 +0000 UTC m=+0.367177450 container init 92569f1ea1a9a577780d1116125ce1babf3578d7324356602504a52a16723a9e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, io.buildah.version=1.33.5, org.label-schema.vendor=CentOS, RELEASE=squid-ea0684c, ceph=True, org.label-schema.build-date=20240521, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.license=GPLv2, maintainer=Guillaume Abrioux , org.label-schema.name=CentOS Stream 8 Base Image, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.schema-version=1.0, GIT_REPO=git@github.com:ceph/ceph-container.git, GIT_BRANCH=HEAD) 2024-05-25T05:44:12.557 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:12 smithi088 podman[156158]: 2024-05-25 05:44:12.177454461 +0000 UTC m=+0.370647659 container start 92569f1ea1a9a577780d1116125ce1babf3578d7324356602504a52a16723a9e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.schema-version=1.0, GIT_CLEAN=True, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2, ceph=True, GIT_REPO=git@github.com:ceph/ceph-container.git, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, CEPH_POINT_RELEASE=, GIT_BRANCH=HEAD, org.label-schema.build-date=20240521, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , io.buildah.version=1.33.5) 2024-05-25T05:44:12.558 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:12 smithi088 podman[156158]: 2024-05-25 05:44:12.2573335 +0000 UTC m=+0.450526730 container attach 92569f1ea1a9a577780d1116125ce1babf3578d7324356602504a52a16723a9e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, org.label-schema.build-date=20240521, ceph=True, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True, CEPH_POINT_RELEASE=, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, org.label-schema.vendor=CentOS, GIT_REPO=git@github.com:ceph/ceph-container.git, io.buildah.version=1.33.5, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.license=GPLv2) 2024-05-25T05:44:13.057 INFO:journalctl@ceph.osd.0.smithi088.stdout:May 25 05:44:12 smithi088 podman[156158]: 2024-05-25 05:44:12.732058623 +0000 UTC m=+0.925251821 container died 92569f1ea1a9a577780d1116125ce1babf3578d7324356602504a52a16723a9e (image=quay.ceph.io/ceph-ci/ceph@sha256:87d6178d73fd8ae7a5c0bfa0c0b94e94dac0cc7c0eff96d5e0b3e0bddc5affee, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-0-deactivate, GIT_REPO=git@github.com:ceph/ceph-container.git, maintainer=Guillaume Abrioux , org.label-schema.build-date=20240521, io.buildah.version=1.33.5, CEPH_POINT_RELEASE=, ceph=True, GIT_BRANCH=HEAD, org.label-schema.license=GPLv2, org.label-schema.schema-version=1.0, RELEASE=squid-ea0684c, GIT_COMMIT=e5230d3b004eecd2f42a9b578ebb9642654e8093, org.label-schema.vendor=CentOS, org.label-schema.name=CentOS Stream 8 Base Image, GIT_CLEAN=True) 2024-05-25T05:44:13.600 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.0.service' 2024-05-25T05:44:13.644 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:13.644 INFO:tasks.cephadm.osd.0:Stopped osd.0 2024-05-25T05:44:13.644 INFO:tasks.cephadm.osd.1:Stopping osd.1... 2024-05-25T05:44:13.645 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.1 2024-05-25T05:44:14.057 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:13 smithi088 systemd[1]: Stopping Ceph osd.1 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:14.057 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1[35795]: 2024-05-25T05:44:13.823+0000 7ff6356b9700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.1 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:14.057 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1[35795]: 2024-05-25T05:44:13.823+0000 7ff6356b9700 -1 osd.1 128 *** Got signal Terminated *** 2024-05-25T05:44:14.058 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:13 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1[35795]: 2024-05-25T05:44:13.823+0000 7ff6356b9700 -1 osd.1 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:44:19.523 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:19 smithi088 podman[156240]: 2024-05-25 05:44:19.233326371 +0000 UTC m=+5.498520973 container died 4c22601512adcaea8b1efc1824e80a666243324df3dbaa9daf66b375e8383782 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1, release=754, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, com.redhat.component=centos-stream-container, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_CLEAN=True, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git) 2024-05-25T05:44:19.806 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:19 smithi088 podman[156240]: 2024-05-25 05:44:19.663681761 +0000 UTC m=+5.928876351 container cleanup 4c22601512adcaea8b1efc1824e80a666243324df3dbaa9daf66b375e8383782 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1, io.buildah.version=1.19.8, architecture=x86_64, RELEASE=HEAD, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, vcs-type=git, GIT_CLEAN=True, ceph=True, vendor=Red Hat, Inc., release=754, version=8, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux ) 2024-05-25T05:44:19.807 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:19 smithi088 bash[156240]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1 2024-05-25T05:44:20.153 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:19 smithi088 podman[156255]: 2024-05-25 05:44:19.873684263 +0000 UTC m=+0.636184144 container remove 4c22601512adcaea8b1efc1824e80a666243324df3dbaa9daf66b375e8383782 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vcs-type=git, io.openshift.tags=base centos centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, release=754, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., architecture=x86_64, GIT_BRANCH=HEAD, RELEASE=HEAD, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, ceph=True, distribution-scope=public, name=centos-stream) 2024-05-25T05:44:20.153 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:19 smithi088 bash[156273]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd.1" found: no such container 2024-05-25T05:44:20.468 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:20 smithi088 podman[156332]: 2024-05-25 05:44:20.057013827 +0000 UTC m=+0.018338684 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:44:20.469 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:20 smithi088 podman[156332]: 2024-05-25 05:44:20.157840572 +0000 UTC m=+0.119165451 container create 7b88bfbb0f93a25ea394649922cefbe66dcd267ca4744431a52b96d91591512b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1-deactivate, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, release=754, name=centos-stream, GIT_BRANCH=HEAD, vcs-type=git, io.openshift.tags=base centos centos-stream, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, com.redhat.component=centos-stream-container, io.openshift.expose-services=, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, CEPH_POINT_RELEASE=-17.2.0) 2024-05-25T05:44:20.469 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:20 smithi088 podman[156332]: 2024-05-25 05:44:20.385566533 +0000 UTC m=+0.346891382 container init 7b88bfbb0f93a25ea394649922cefbe66dcd267ca4744431a52b96d91591512b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1-deactivate, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, release=754, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, version=8, ceph=True, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD, vcs-type=git, GIT_CLEAN=True, vendor=Red Hat, Inc., distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-25T05:44:20.469 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:20 smithi088 podman[156332]: 2024-05-25 05:44:20.388986619 +0000 UTC m=+0.350311477 container start 7b88bfbb0f93a25ea394649922cefbe66dcd267ca4744431a52b96d91591512b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1-deactivate, release=754, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , GIT_BRANCH=HEAD, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, distribution-scope=public, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, version=8, ceph=True) 2024-05-25T05:44:20.469 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:20 smithi088 podman[156332]: 2024-05-25 05:44:20.468956912 +0000 UTC m=+0.430281784 container attach 7b88bfbb0f93a25ea394649922cefbe66dcd267ca4744431a52b96d91591512b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1-deactivate, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vendor=Red Hat, Inc., release=754, version=8, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , GIT_CLEAN=True, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, distribution-scope=public, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=) 2024-05-25T05:44:20.807 INFO:journalctl@ceph.osd.1.smithi088.stdout:May 25 05:44:20 smithi088 podman[156332]: 2024-05-25 05:44:20.670429833 +0000 UTC m=+0.631754691 container died 7b88bfbb0f93a25ea394649922cefbe66dcd267ca4744431a52b96d91591512b (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-1-deactivate, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.expose-services=, ceph=True, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, architecture=x86_64, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., version=8, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, release=754, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-05-25T05:44:21.342 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.1.service' 2024-05-25T05:44:21.382 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:21.383 INFO:tasks.cephadm.osd.1:Stopped osd.1 2024-05-25T05:44:21.383 INFO:tasks.cephadm.osd.2:Stopping osd.2... 2024-05-25T05:44:21.383 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.2 2024-05-25T05:44:21.576 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:21 smithi088 systemd[1]: Stopping Ceph osd.2 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:22.057 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2[38713]: 2024-05-25T05:44:21.575+0000 7fa5aa764700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.2 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:22.057 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2[38713]: 2024-05-25T05:44:21.575+0000 7fa5aa764700 -1 osd.2 128 *** Got signal Terminated *** 2024-05-25T05:44:22.057 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:21 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2[38713]: 2024-05-25T05:44:21.575+0000 7fa5aa764700 -1 osd.2 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:44:27.276 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:27 smithi088 podman[156411]: 2024-05-25 05:44:27.013052533 +0000 UTC m=+5.528612681 container died f9fa605a8ed9fb128ac7105a50f6be8b0c77a39e17ce982908e7d00d749e1356 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2, GIT_CLEAN=True, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , version=8, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, ceph=True, io.openshift.expose-services=, GIT_BRANCH=HEAD, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, build-date=2022-05-03T08:36:31.336870) 2024-05-25T05:44:27.557 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:27 smithi088 podman[156411]: 2024-05-25 05:44:27.466754661 +0000 UTC m=+5.982314808 container cleanup f9fa605a8ed9fb128ac7105a50f6be8b0c77a39e17ce982908e7d00d749e1356 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, version=8, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, GIT_CLEAN=True, RELEASE=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, architecture=x86_64) 2024-05-25T05:44:27.557 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:27 smithi088 bash[156411]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2 2024-05-25T05:44:27.557 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:27 smithi088 bash[156704]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd.2" found: no such container 2024-05-25T05:44:27.635 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:44:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:44:27.358Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=nvmeof msg="Unable to refresh target groups" err="Get \"http://172.21.15.88:8765/sd/prometheus/sd-config?service=nvmeof\": dial tcp 172.21.15.88:8765: connect: connection refused" 2024-05-25T05:44:27.636 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:44:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:44:27.358Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=node msg="Unable to refresh target groups" err="Get \"http://172.21.15.88:8765/sd/prometheus/sd-config?service=node-exporter\": dial tcp 172.21.15.88:8765: connect: connection refused" 2024-05-25T05:44:27.636 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:44:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:44:27.360Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph-exporter msg="Unable to refresh target groups" err="Get \"http://172.21.15.88:8765/sd/prometheus/sd-config?service=ceph-exporter\": dial tcp 172.21.15.88:8765: connect: connection refused" 2024-05-25T05:44:27.636 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:44:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:44:27.360Z caller=refresh.go:99 level=error component="discovery manager notify" discovery=http config=config-0 msg="Unable to refresh target groups" err="Get \"http://172.21.15.88:8765/sd/prometheus/sd-config?service=alertmanager\": dial tcp 172.21.15.88:8765: connect: connection refused" 2024-05-25T05:44:27.636 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:44:27 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:44:27.360Z caller=refresh.go:99 level=error component="discovery manager scrape" discovery=http config=ceph msg="Unable to refresh target groups" err="Get \"http://172.21.15.88:8765/sd/prometheus/sd-config?service=mgr-prometheus\": dial tcp 172.21.15.88:8765: connect: connection refused" 2024-05-25T05:44:28.052 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:27 smithi088 podman[156680]: 2024-05-25 05:44:27.793635225 +0000 UTC m=+0.778619692 container remove f9fa605a8ed9fb128ac7105a50f6be8b0c77a39e17ce982908e7d00d749e1356 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2, vendor=Red Hat, Inc., GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, release=754, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.expose-services=, version=8, name=centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, ceph=True) 2024-05-25T05:44:28.052 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:27 smithi088 podman[156780]: 2024-05-25 05:44:27.847311767 +0000 UTC m=+0.021807577 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:44:28.307 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:28 smithi088 podman[156780]: 2024-05-25 05:44:28.138110518 +0000 UTC m=+0.312606314 container create 03979a9ddd5557ac9164010c9581ac00305a8b98ac4f66f92042dd21f7b62235 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2-deactivate, build-date=2022-05-03T08:36:31.336870, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD, release=754, CEPH_POINT_RELEASE=-17.2.0, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, GIT_REPO=https://github.com/ceph/ceph-container.git, io.openshift.expose-services=, architecture=x86_64, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, name=centos-stream, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, GIT_CLEAN=True, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True) 2024-05-25T05:44:28.579 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:28 smithi088 podman[156780]: 2024-05-25 05:44:28.329196711 +0000 UTC m=+0.503692508 container init 03979a9ddd5557ac9164010c9581ac00305a8b98ac4f66f92042dd21f7b62235 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2-deactivate, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, vendor=Red Hat, Inc., distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, CEPH_POINT_RELEASE=-17.2.0, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, ceph=True, maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, vcs-type=git, io.openshift.expose-services=, version=8, com.redhat.component=centos-stream-container) 2024-05-25T05:44:28.580 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:28 smithi088 podman[156780]: 2024-05-25 05:44:28.33256907 +0000 UTC m=+0.507064874 container start 03979a9ddd5557ac9164010c9581ac00305a8b98ac4f66f92042dd21f7b62235 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2-deactivate, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, architecture=x86_64, name=centos-stream, GIT_BRANCH=HEAD, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, release=754, io.openshift.expose-services=, RELEASE=HEAD, vcs-type=git, io.buildah.version=1.19.8, ceph=True) 2024-05-25T05:44:28.580 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:28 smithi088 podman[156780]: 2024-05-25 05:44:28.415480304 +0000 UTC m=+0.589976104 container attach 03979a9ddd5557ac9164010c9581ac00305a8b98ac4f66f92042dd21f7b62235 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2-deactivate, architecture=x86_64, distribution-scope=public, ceph=True, build-date=2022-05-03T08:36:31.336870, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, version=8, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., io.openshift.expose-services=, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, vcs-type=git, io.buildah.version=1.19.8, release=754) 2024-05-25T05:44:29.556 INFO:journalctl@ceph.osd.2.smithi088.stdout:May 25 05:44:29 smithi088 podman[156780]: 2024-05-25 05:44:29.34900283 +0000 UTC m=+1.523498638 container died 03979a9ddd5557ac9164010c9581ac00305a8b98ac4f66f92042dd21f7b62235 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-2-deactivate, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, io.openshift.expose-services=, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, vendor=Red Hat, Inc., CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, distribution-scope=public, ceph=True, maintainer=Guillaume Abrioux , version=8, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git) 2024-05-25T05:44:29.979 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.2.service' 2024-05-25T05:44:30.023 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:30.024 INFO:tasks.cephadm.osd.2:Stopped osd.2 2024-05-25T05:44:30.024 INFO:tasks.cephadm.osd.3:Stopping osd.3... 2024-05-25T05:44:30.024 DEBUG:teuthology.orchestra.run.smithi088:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.3 2024-05-25T05:44:30.232 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:30 smithi088 systemd[1]: Stopping Ceph osd.3 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:30.502 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3[41686]: 2024-05-25T05:44:30.321+0000 7f642c083700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.3 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:30.503 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3[41686]: 2024-05-25T05:44:30.321+0000 7f642c083700 -1 osd.3 128 *** Got signal Terminated *** 2024-05-25T05:44:30.503 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:30 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3[41686]: 2024-05-25T05:44:30.321+0000 7f642c083700 -1 osd.3 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:44:31.884 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:31.471+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:32.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:31 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:31.981+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:32.884 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:32 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:32.483+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:33.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:32 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:32.954+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:33.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:33.489+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:34.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:33 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:33.916+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:34.884 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:34.530+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:34.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:34.710+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:35.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:34.887+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:35.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:34 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:34.987+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:35.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:35.493+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:35.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:35.675+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:35.898 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:35 smithi088 podman[156957]: 2024-05-25 05:44:35.641763128 +0000 UTC m=+5.532519831 container died 6985caf6a798dd5d9f50719e75b137a7ce2ea5ba60c03b339afb7bc4ad80d624 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, architecture=x86_64, release=754, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, build-date=2022-05-03T08:36:31.336870, version=8, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, RELEASE=HEAD, name=centos-stream, maintainer=Guillaume Abrioux , io.openshift.expose-services=) 2024-05-25T05:44:36.272 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 podman[156957]: 2024-05-25 05:44:36.063545909 +0000 UTC m=+5.954302613 container cleanup 6985caf6a798dd5d9f50719e75b137a7ce2ea5ba60c03b339afb7bc4ad80d624 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3, build-date=2022-05-03T08:36:31.336870, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, architecture=x86_64, vcs-type=git, maintainer=Guillaume Abrioux , GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.openshift.tags=base centos centos-stream, ceph=True, distribution-scope=public, io.buildah.version=1.19.8, GIT_BRANCH=HEAD, io.openshift.expose-services=, version=8, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, RELEASE=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git) 2024-05-25T05:44:36.273 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 bash[156957]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3 2024-05-25T05:44:36.273 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 bash[157404]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd.3" found: no such container 2024-05-25T05:44:36.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:35 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:35.926+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:36.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:36.013+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:36.532 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 podman[157390]: 2024-05-25 05:44:36.27330698 +0000 UTC m=+0.629756904 container remove 6985caf6a798dd5d9f50719e75b137a7ce2ea5ba60c03b339afb7bc4ad80d624 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3, io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, distribution-scope=public, io.buildah.version=1.19.8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., version=8, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, com.redhat.component=centos-stream-container, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, name=centos-stream, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git) 2024-05-25T05:44:36.532 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 podman[157466]: 2024-05-25 05:44:36.400759373 +0000 UTC m=+0.018210272 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:44:36.532 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 podman[157466]: 2024-05-25 05:44:36.532722324 +0000 UTC m=+0.150173218 container create 3e2db58f080049028e357c30ef5fc969901ccc2dd1fb6402f941248f9a47f810 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3-deactivate, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, vcs-type=git, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, architecture=x86_64, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, name=centos-stream, version=8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, build-date=2022-05-03T08:36:31.336870, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, GIT_CLEAN=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, release=754) 2024-05-25T05:44:36.801 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 podman[157466]: 2024-05-25 05:44:36.718949301 +0000 UTC m=+0.336400176 container init 3e2db58f080049028e357c30ef5fc969901ccc2dd1fb6402f941248f9a47f810 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3-deactivate, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, version=8, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-17.2.0, release=754, name=centos-stream, distribution-scope=public, architecture=x86_64) 2024-05-25T05:44:36.801 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 podman[157466]: 2024-05-25 05:44:36.722503204 +0000 UTC m=+0.339954082 container start 3e2db58f080049028e357c30ef5fc969901ccc2dd1fb6402f941248f9a47f810 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3-deactivate, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, ceph=True, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, GIT_BRANCH=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, version=8, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, distribution-scope=public) 2024-05-25T05:44:36.802 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:36 smithi088 podman[157466]: 2024-05-25 05:44:36.801859015 +0000 UTC m=+0.419309893 container attach 3e2db58f080049028e357c30ef5fc969901ccc2dd1fb6402f941248f9a47f810 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3-deactivate, com.redhat.component=centos-stream-container, release=754, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, version=8, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, name=centos-stream, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.openshift.expose-services=, GIT_BRANCH=HEAD, RELEASE=HEAD, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., distribution-scope=public, GIT_CLEAN=True) 2024-05-25T05:44:36.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:36.444+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:36.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:36.663+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:37.057 INFO:journalctl@ceph.osd.3.smithi088.stdout:May 25 05:44:37 smithi088 podman[157466]: 2024-05-25 05:44:37.004557555 +0000 UTC m=+0.622008430 container died 3e2db58f080049028e357c30ef5fc969901ccc2dd1fb6402f941248f9a47f810 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-3-deactivate, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., release=754, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, GIT_CLEAN=True, io.buildah.version=1.19.8, io.openshift.expose-services=, io.k8s.display-name=CentOS Stream 8, ceph=True, distribution-scope=public, RELEASE=HEAD, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, architecture=x86_64, version=8) 2024-05-25T05:44:37.281 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:36 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:36.970+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:37.281 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:37.059+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:37.634 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:37.444+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:37.780 DEBUG:teuthology.orchestra.run.smithi088:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.3.service' 2024-05-25T05:44:37.822 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:37.823 INFO:tasks.cephadm.osd.3:Stopped osd.3 2024-05-25T05:44:37.823 INFO:tasks.cephadm.osd.4:Stopping osd.4... 2024-05-25T05:44:37.823 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.4 2024-05-25T05:44:37.993 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:37.677+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:37.994 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:37 smithi136 systemd[1]: Stopping Ceph osd.4 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:38.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:37 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:37.992+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:38.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:38.044+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:38.728 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:38.435+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:38.728 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:38.628+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:38.729 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:38.629+0000 7f58fbf7d700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.4 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:38.729 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:38.629+0000 7f58fbf7d700 -1 osd.4 128 *** Got signal Terminated *** 2024-05-25T05:44:38.729 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:38.630+0000 7f58fbf7d700 -1 osd.4 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:44:39.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:38 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:38.991+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:39.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:39.000+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:39.740 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:39.406+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:39.740 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:39.588+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:39.740 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:39 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:39.588+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.019710+0000 front 2024-05-25T05:44:16.019697+0000 (oldest deadline 2024-05-25T05:44:39.519560+0000) 2024-05-25T05:44:40.385 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:40.000+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:40.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:40.004+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:40.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:40.430+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:40.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:40.598+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:40.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:40.598+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.019710+0000 front 2024-05-25T05:44:16.019697+0000 (oldest deadline 2024-05-25T05:44:39.519560+0000) 2024-05-25T05:44:41.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:40.956+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:41.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:40.966+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:41.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:40 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:40.966+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:41.884 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:41.407+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:41.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:41.572+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:41.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:41.572+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.019710+0000 front 2024-05-25T05:44:16.019697+0000 (oldest deadline 2024-05-25T05:44:39.519560+0000) 2024-05-25T05:44:42.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:41.923+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:42.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:41.918+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:42.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:41 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:41.918+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:42.634 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:42.383+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:42.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:42.383+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:42.635 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:42.572+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:42.635 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:42.572+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.019710+0000 front 2024-05-25T05:44:16.019697+0000 (oldest deadline 2024-05-25T05:44:39.519560+0000) 2024-05-25T05:44:43.290 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:42.935+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:43.291 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:42.905+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:43.291 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:42 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:42.905+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:43.553 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:43.383+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:43.553 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:43.383+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:43.884 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:43.553+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.118095+0000 front 2024-05-25T05:44:09.117989+0000 (oldest deadline 2024-05-25T05:44:33.818109+0000) 2024-05-25T05:44:43.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4[30300]: 2024-05-25T05:44:43.553+0000 7f58f7916700 -1 osd.4 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.019710+0000 front 2024-05-25T05:44:16.019697+0000 (oldest deadline 2024-05-25T05:44:39.519560+0000) 2024-05-25T05:44:44.384 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:44 smithi136 podman[133561]: 2024-05-25 05:44:44.131584358 +0000 UTC m=+6.245583112 container died 54ac1ccc49c0c80c192377cc5d1309b657e9202f24b1f4fe36e303e4ad36ae20 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, architecture=x86_64, version=8, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0, GIT_REPO=https://github.com/ceph/ceph-container.git, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, com.redhat.component=centos-stream-container, io.openshift.expose-services=, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_BRANCH=HEAD) 2024-05-25T05:44:44.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:43.930+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:44.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:43.930+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:44.385 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:43.948+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:44.386 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:43 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:43.949+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:44.836 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:44.392+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:44.837 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:44.392+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:44.837 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:44 smithi136 podman[133561]: 2024-05-25 05:44:44.543398469 +0000 UTC m=+6.657397223 container cleanup 54ac1ccc49c0c80c192377cc5d1309b657e9202f24b1f4fe36e303e4ad36ae20 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.display-name=CentOS Stream 8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, vendor=Red Hat, Inc., io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., vcs-type=git, version=8, architecture=x86_64, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.buildah.version=1.19.8, release=754, ceph=True, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, io.openshift.tags=base centos centos-stream) 2024-05-25T05:44:44.837 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:44 smithi136 bash[133561]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4 2024-05-25T05:44:44.838 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:44 smithi136 bash[133922]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd.4" found: no such container 2024-05-25T05:44:45.112 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:44.974+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:45.112 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:44.974+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:45.113 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:44.934+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:45.113 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:44.934+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:45.113 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:44 smithi136 podman[133909]: 2024-05-25 05:44:44.836892364 +0000 UTC m=+0.704162155 container remove 54ac1ccc49c0c80c192377cc5d1309b657e9202f24b1f4fe36e303e4ad36ae20 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, com.redhat.component=centos-stream-container, architecture=x86_64, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, ceph=True, io.openshift.expose-services=, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, maintainer=Guillaume Abrioux , io.buildah.version=1.19.8, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, io.openshift.tags=base centos centos-stream, vcs-type=git, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True) 2024-05-25T05:44:45.113 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:45 smithi136 podman[134006]: 2024-05-25 05:44:44.985993015 +0000 UTC m=+0.022379618 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:44:45.114 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:45 smithi136 podman[134006]: 2024-05-25 05:44:45.113000148 +0000 UTC m=+0.149386751 container create 4bef58640b83758295b179f1992c53e3c5f533a56cc5c1bb83a7a8809740b1ba (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4-deactivate, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, vendor=Red Hat, Inc., GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, architecture=x86_64, GIT_BRANCH=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.display-name=CentOS Stream 8, distribution-scope=public, io.openshift.tags=base centos centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, name=centos-stream, vcs-type=git, release=754, maintainer=Guillaume Abrioux ) 2024-05-25T05:44:45.384 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:45 smithi136 podman[134006]: 2024-05-25 05:44:45.332404486 +0000 UTC m=+0.368791091 container init 4bef58640b83758295b179f1992c53e3c5f533a56cc5c1bb83a7a8809740b1ba (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4-deactivate, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, distribution-scope=public, com.redhat.component=centos-stream-container, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, ceph=True, release=754, io.k8s.display-name=CentOS Stream 8, architecture=x86_64, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, vcs-type=git, GIT_CLEAN=True, version=8, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-05-25T05:44:45.385 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:45 smithi136 podman[134006]: 2024-05-25 05:44:45.335698194 +0000 UTC m=+0.372084803 container start 4bef58640b83758295b179f1992c53e3c5f533a56cc5c1bb83a7a8809740b1ba (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4-deactivate, GIT_BRANCH=HEAD, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.buildah.version=1.19.8, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, vendor=Red Hat, Inc., version=8, maintainer=Guillaume Abrioux , url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, distribution-scope=public, release=754, name=centos-stream, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, architecture=x86_64, ceph=True, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/) 2024-05-25T05:44:45.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:45 smithi136 podman[134006]: 2024-05-25 05:44:45.415725886 +0000 UTC m=+0.452112489 container attach 4bef58640b83758295b179f1992c53e3c5f533a56cc5c1bb83a7a8809740b1ba (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4-deactivate, io.k8s.display-name=CentOS Stream 8, vcs-type=git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_CLEAN=True, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, architecture=x86_64, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, ceph=True, version=8, io.buildah.version=1.19.8, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-05-25T05:44:45.885 INFO:journalctl@ceph.osd.4.smithi136.stdout:May 25 05:44:45 smithi136 podman[134006]: 2024-05-25 05:44:45.618006615 +0000 UTC m=+0.654393220 container died 4bef58640b83758295b179f1992c53e3c5f533a56cc5c1bb83a7a8809740b1ba (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-4-deactivate, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, io.buildah.version=1.19.8, name=centos-stream, GIT_CLEAN=True, vendor=Red Hat, Inc., com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, architecture=x86_64, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, com.redhat.component=centos-stream-container, vcs-type=git, GIT_BRANCH=HEAD, io.openshift.expose-services=, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, build-date=2022-05-03T08:36:31.336870, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, CEPH_POINT_RELEASE=-17.2.0, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux ) 2024-05-25T05:44:45.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:45.427+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:45.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:45.427+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:46.320 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:45.928+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:46.321 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:45.928+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:46.321 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:45.930+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:46.321 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:45 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:45.930+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:46.348 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.4.service' 2024-05-25T05:44:46.387 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:46.388 INFO:tasks.cephadm.osd.4:Stopped osd.4 2024-05-25T05:44:46.388 INFO:tasks.cephadm.osd.5:Stopping osd.5... 2024-05-25T05:44:46.388 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.5 2024-05-25T05:44:46.598 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:46.460+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:46.598 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:46.460+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:46.599 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:46 smithi136 systemd[1]: Stopping Ceph osd.5 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:47.225 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:46.967+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:47.225 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:46.967+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:47.225 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:46.884+0000 7f537f692700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.5 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:47.226 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:46.884+0000 7f537f692700 -1 osd.5 128 *** Got signal Terminated *** 2024-05-25T05:44:47.226 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:46.884+0000 7f537f692700 -1 osd.5 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:44:47.226 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:46.972+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:47.226 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:46 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:46.972+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:47.477 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:47.451+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:47.477 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:47.451+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:48.222 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:48.022+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:48.223 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:48.022+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:48.223 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:47.950+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:48.223 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:47 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:47.950+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:48.634 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:48.431+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:48.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:48.431+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:49.004 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:48.960+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:49.005 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:48 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:48.960+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:49.278 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:49.003+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:49.279 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:49.003+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:49.279 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:49.003+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:24.660762+0000 front 2024-05-25T05:44:24.660682+0000 (oldest deadline 2024-05-25T05:44:48.760673+0000) 2024-05-25T05:44:49.634 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:49.433+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:49.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:49.433+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:50.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:49.967+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:50.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:49 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:49.967+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:50.385 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:50.035+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:50.385 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:50.035+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:50.386 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:50.035+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:24.660762+0000 front 2024-05-25T05:44:24.660682+0000 (oldest deadline 2024-05-25T05:44:48.760673+0000) 2024-05-25T05:44:50.884 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:50.423+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:50.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:50.423+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:50.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:50 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:50.423+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:51.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:51.038+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:08.057328+0000 front 2024-05-25T05:44:08.057431+0000 (oldest deadline 2024-05-25T05:44:30.957223+0000) 2024-05-25T05:44:51.385 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:51.038+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:16.559603+0000 front 2024-05-25T05:44:16.559700+0000 (oldest deadline 2024-05-25T05:44:42.959865+0000) 2024-05-25T05:44:51.385 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5[33160]: 2024-05-25T05:44:51.038+0000 7f537b82c700 -1 osd.5 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:24.660762+0000 front 2024-05-25T05:44:24.660682+0000 (oldest deadline 2024-05-25T05:44:48.760673+0000) 2024-05-25T05:44:51.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:51.008+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:51.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:51.008+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:51.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:51.008+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:51.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:51.429+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:51.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:51.429+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:51.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:51 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:51.429+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:52.384 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:52 smithi136 podman[134123]: 2024-05-25 05:44:52.273939348 +0000 UTC m=+5.797860755 container died c8648e2982d9cc606eb57d9fa567c1fc2ecf013b0e7e4d1e11bd887c1f203fd5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5, com.redhat.component=centos-stream-container, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, GIT_BRANCH=HEAD, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_REPO=https://github.com/ceph/ceph-container.git, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, ceph=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , GIT_CLEAN=True, release=754, build-date=2022-05-03T08:36:31.336870, name=centos-stream, io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vcs-type=git, vendor=Red Hat, Inc., architecture=x86_64) 2024-05-25T05:44:52.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:52 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:52.030+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:52.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:52 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:52.030+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:52.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:52 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:52.030+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:52.703 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:52 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:52.438+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:52.704 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:52 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:52.438+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:52.704 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:52 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:52.438+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:52.961 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:52 smithi136 podman[134123]: 2024-05-25 05:44:52.704300042 +0000 UTC m=+6.228221492 container cleanup c8648e2982d9cc606eb57d9fa567c1fc2ecf013b0e7e4d1e11bd887c1f203fd5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5, io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, release=754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, architecture=x86_64, vcs-type=git, maintainer=Guillaume Abrioux , com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, io.openshift.expose-services=, version=8, ceph=True, name=centos-stream, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, GIT_BRANCH=HEAD, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, vendor=Red Hat, Inc., io.k8s.display-name=CentOS Stream 8, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-05-25T05:44:52.961 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:52 smithi136 bash[134123]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5 2024-05-25T05:44:52.961 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:52 smithi136 podman[134450]: 2024-05-25 05:44:52.922679527 +0000 UTC m=+0.645379117 container remove c8648e2982d9cc606eb57d9fa567c1fc2ecf013b0e7e4d1e11bd887c1f203fd5 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5, name=centos-stream, version=8, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, distribution-scope=public, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.openshift.tags=base centos centos-stream, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, CEPH_POINT_RELEASE=-17.2.0, GIT_CLEAN=True, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , vendor=Red Hat, Inc., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, release=754, architecture=x86_64, GIT_BRANCH=HEAD, ceph=True) 2024-05-25T05:44:53.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:52 smithi136 bash[134464]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd.5" found: no such container 2024-05-25T05:44:53.231 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:53 smithi136 podman[134523]: 2024-05-25 05:44:53.101978791 +0000 UTC m=+0.018261846 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:44:53.232 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:53.033+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:53.232 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:53.033+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:53.232 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:53.033+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:53.568 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:53.462+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:53.569 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:53.462+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:53.569 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:53 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:53.462+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:53.569 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:53 smithi136 podman[134523]: 2024-05-25 05:44:53.231988898 +0000 UTC m=+0.148271987 container create ffa5460ae9ce40b8669c311c1fa6239db5ac50dbfe48e573423c748f18585b1e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5-deactivate, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, vcs-type=git, io.k8s.display-name=CentOS Stream 8, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_CLEAN=True, distribution-scope=public, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, RELEASE=HEAD, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, release=754, name=centos-stream, vendor=Red Hat, Inc., io.openshift.tags=base centos centos-stream, ceph=True, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-05-25T05:44:53.569 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:53 smithi136 podman[134523]: 2024-05-25 05:44:53.443017205 +0000 UTC m=+0.359300252 container init ffa5460ae9ce40b8669c311c1fa6239db5ac50dbfe48e573423c748f18585b1e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5-deactivate, vendor=Red Hat, Inc., description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, release=754, GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, io.openshift.expose-services=, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, distribution-scope=public, RELEASE=HEAD, ceph=True, name=centos-stream, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_REPO=https://github.com/ceph/ceph-container.git, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image) 2024-05-25T05:44:53.569 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:53 smithi136 podman[134523]: 2024-05-25 05:44:53.44646368 +0000 UTC m=+0.362746731 container start ffa5460ae9ce40b8669c311c1fa6239db5ac50dbfe48e573423c748f18585b1e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5-deactivate, version=8, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, ceph=True, CEPH_POINT_RELEASE=-17.2.0, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_BRANCH=HEAD, vcs-type=git, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, io.openshift.expose-services=, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vendor=Red Hat, Inc., architecture=x86_64, distribution-scope=public) 2024-05-25T05:44:53.570 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:53 smithi136 podman[134523]: 2024-05-25 05:44:53.569022207 +0000 UTC m=+0.485305257 container attach ffa5460ae9ce40b8669c311c1fa6239db5ac50dbfe48e573423c748f18585b1e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5-deactivate, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, io.buildah.version=1.19.8, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., name=centos-stream, maintainer=Guillaume Abrioux , com.redhat.license_terms=https://centos.org/legal/licensing-policy/, architecture=x86_64, distribution-scope=public, io.openshift.expose-services=, CEPH_POINT_RELEASE=-17.2.0, version=8, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.display-name=CentOS Stream 8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., vcs-type=git) 2024-05-25T05:44:53.885 INFO:journalctl@ceph.osd.5.smithi136.stdout:May 25 05:44:53 smithi136 podman[134523]: 2024-05-25 05:44:53.733166569 +0000 UTC m=+0.649449622 container died ffa5460ae9ce40b8669c311c1fa6239db5ac50dbfe48e573423c748f18585b1e (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-5-deactivate, release=754, io.openshift.expose-services=, build-date=2022-05-03T08:36:31.336870, RELEASE=HEAD, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_REPO=https://github.com/ceph/ceph-container.git, vendor=Red Hat, Inc., version=8, io.k8s.display-name=CentOS Stream 8, GIT_CLEAN=True, io.buildah.version=1.19.8, ceph=True, GIT_BRANCH=HEAD, vcs-type=git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, CEPH_POINT_RELEASE=-17.2.0, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, architecture=x86_64, io.openshift.tags=base centos centos-stream, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-05-25T05:44:54.371 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:54.015+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:54.371 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:54.015+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:54.372 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:54.015+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:54.386 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.5.service' 2024-05-25T05:44:54.426 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:44:54.427 INFO:tasks.cephadm.osd.5:Stopped osd.5 2024-05-25T05:44:54.427 INFO:tasks.cephadm.osd.6:Stopping osd.6... 2024-05-25T05:44:54.427 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.6 2024-05-25T05:44:54.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:54.478+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:54.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:54.478+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:54.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:54.478+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:54.636 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:54 smithi136 systemd[1]: Stopping Ceph osd.6 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:44:54.636 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:54.615+0000 7fd0b6f62700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.6 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:44:54.636 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:54.615+0000 7fd0b6f62700 -1 osd.6 128 *** Got signal Terminated *** 2024-05-25T05:44:54.636 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:54.615+0000 7fd0b6f62700 -1 osd.6 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:44:55.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:54.983+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:55.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:54.983+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:55.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:54 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:54.983+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:55.884 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:55.492+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:55.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:55.492+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:55.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:55 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:55.492+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:56.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:56.016+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:56.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:56.016+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:56.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:56.016+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:56.884 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:56.457+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:56.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:56.457+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:56.885 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:56 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:56.457+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:57.353 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:57.037+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:57.354 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:57.037+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:57.354 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:57.037+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:57.354 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:57.037+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:44:57.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:57.440+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:57.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:57.440+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:57.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:57 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:57.440+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:58.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:58.061+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:58.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:58.061+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:58.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:58.061+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:58.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:58.061+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:44:58.688 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:58.407+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:58.688 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:58.407+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:58.688 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:58 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:58.407+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:44:59.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.028+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:44:59.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.028+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:44:59.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.028+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:44:59.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.028+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:44:59.752 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:59.390+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:06.003675+0000 front 2024-05-25T05:44:06.003689+0000 (oldest deadline 2024-05-25T05:44:31.204043+0000) 2024-05-25T05:44:59.752 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:59.390+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:17.605515+0000 front 2024-05-25T05:44:17.605565+0000 (oldest deadline 2024-05-25T05:44:42.305477+0000) 2024-05-25T05:44:59.752 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6[36068]: 2024-05-25T05:44:59.390+0000 7fd0b08f7700 -1 osd.6 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:26.306723+0000 front 2024-05-25T05:44:26.306685+0000 (oldest deadline 2024-05-25T05:44:49.806783+0000) 2024-05-25T05:45:00.045 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.998+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:00.045 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.998+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:00.045 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.998+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:00.045 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:44:59 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:44:59.998+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:00.323 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:00 smithi136 podman[134602]: 2024-05-25 05:45:00.054083373 +0000 UTC m=+5.535620077 container died 6e494205dc02fc8dfd7c7e370fc5cf52e25fca9868ce49059913a461a58416c0 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6, io.buildah.version=1.19.8, io.openshift.tags=base centos centos-stream, RELEASE=HEAD, distribution-scope=public, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , ceph=True, io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, GIT_CLEAN=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., GIT_BRANCH=HEAD, version=8, architecture=x86_64, release=754, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, GIT_REPO=https://github.com/ceph/ceph-container.git, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, CEPH_POINT_RELEASE=-17.2.0, vcs-type=git, build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, io.k8s.display-name=CentOS Stream 8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream) 2024-05-25T05:45:00.589 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:00 smithi136 podman[134602]: 2024-05-25 05:45:00.397513129 +0000 UTC m=+5.879049835 container cleanup 6e494205dc02fc8dfd7c7e370fc5cf52e25fca9868ce49059913a461a58416c0 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, CEPH_POINT_RELEASE=-17.2.0, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, GIT_CLEAN=True, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, version=8, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, vcs-type=git, architecture=x86_64, io.buildah.version=1.19.8, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc.) 2024-05-25T05:45:00.590 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:00 smithi136 bash[134602]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6 2024-05-25T05:45:00.857 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:00 smithi136 podman[134732]: 2024-05-25 05:45:00.590413889 +0000 UTC m=+0.528815544 container remove 6e494205dc02fc8dfd7c7e370fc5cf52e25fca9868ce49059913a461a58416c0 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, version=8, GIT_BRANCH=HEAD, io.openshift.expose-services=, vcs-type=git, build-date=2022-05-03T08:36:31.336870, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, vendor=Red Hat, Inc., release=754, ceph=True, io.k8s.display-name=CentOS Stream 8, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, io.buildah.version=1.19.8, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, CEPH_POINT_RELEASE=-17.2.0, name=centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-25T05:45:00.858 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:00 smithi136 bash[134747]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd.6" found: no such container 2024-05-25T05:45:00.858 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:00 smithi136 podman[134807]: 2024-05-25 05:45:00.739928813 +0000 UTC m=+0.017901884 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:45:00.858 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:00 smithi136 podman[134807]: 2024-05-25 05:45:00.858097605 +0000 UTC m=+0.136070672 container create 884dfb7ae6727eb61fd2b81b3154b30da1b8f064fdada956a81ae40472f9d2eb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6-deactivate, architecture=x86_64, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., release=754, io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, maintainer=Guillaume Abrioux , vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, version=8, vcs-type=git, com.redhat.component=centos-stream-container, distribution-scope=public, vendor=Red Hat, Inc., GIT_CLEAN=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, name=centos-stream, ceph=True, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754) 2024-05-25T05:45:01.134 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:01 smithi136 podman[134807]: 2024-05-25 05:45:01.068564273 +0000 UTC m=+0.346537339 container init 884dfb7ae6727eb61fd2b81b3154b30da1b8f064fdada956a81ae40472f9d2eb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6-deactivate, ceph=True, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_CLEAN=True, name=centos-stream, GIT_BRANCH=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, com.redhat.component=centos-stream-container, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, vcs-type=git, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.buildah.version=1.19.8, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, release=754, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, maintainer=Guillaume Abrioux , architecture=x86_64, io.openshift.tags=base centos centos-stream, vendor=Red Hat, Inc.) 2024-05-25T05:45:01.135 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:01 smithi136 podman[134807]: 2024-05-25 05:45:01.071933942 +0000 UTC m=+0.349907009 container start 884dfb7ae6727eb61fd2b81b3154b30da1b8f064fdada956a81ae40472f9d2eb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6-deactivate, version=8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public, RELEASE=HEAD, io.buildah.version=1.19.8, release=754, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, ceph=True, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.expose-services=, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, GIT_BRANCH=HEAD, com.redhat.component=centos-stream-container, architecture=x86_64, GIT_CLEAN=True, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vendor=Red Hat, Inc.) 2024-05-25T05:45:01.135 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:01.035+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:01.135 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:01.036+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:01.135 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:01.036+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:01.136 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:01 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:01.036+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:01.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:01 smithi136 podman[134807]: 2024-05-25 05:45:01.161071361 +0000 UTC m=+0.439044444 container attach 884dfb7ae6727eb61fd2b81b3154b30da1b8f064fdada956a81ae40472f9d2eb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6-deactivate, ceph=True, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, RELEASE=HEAD, com.redhat.component=centos-stream-container, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, release=754, io.k8s.display-name=CentOS Stream 8, io.openshift.expose-services=, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, name=centos-stream, version=8, vendor=Red Hat, Inc., summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, architecture=x86_64, io.openshift.tags=base centos centos-stream, io.buildah.version=1.19.8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, CEPH_POINT_RELEASE=-17.2.0, distribution-scope=public) 2024-05-25T05:45:01.635 INFO:journalctl@ceph.osd.6.smithi136.stdout:May 25 05:45:01 smithi136 podman[134807]: 2024-05-25 05:45:01.349461882 +0000 UTC m=+0.627434951 container died 884dfb7ae6727eb61fd2b81b3154b30da1b8f064fdada956a81ae40472f9d2eb (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-6-deactivate, distribution-scope=public, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, architecture=x86_64, com.redhat.component=centos-stream-container, name=centos-stream, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, vcs-type=git, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, ceph=True, GIT_REPO=https://github.com/ceph/ceph-container.git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, maintainer=Guillaume Abrioux , io.k8s.display-name=CentOS Stream 8, GIT_BRANCH=HEAD, io.openshift.expose-services=, version=8, vendor=Red Hat, Inc., GIT_CLEAN=True, release=754, CEPH_POINT_RELEASE=-17.2.0, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, RELEASE=HEAD) 2024-05-25T05:45:02.009 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.6.service' 2024-05-25T05:45:02.048 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:45:02.048 INFO:tasks.cephadm.osd.6:Stopped osd.6 2024-05-25T05:45:02.048 INFO:tasks.cephadm.osd.7:Stopping osd.7... 2024-05-25T05:45:02.049 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.7 2024-05-25T05:45:02.110 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:02.016+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:02.111 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:02.016+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:02.111 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:02.016+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:02.111 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:02.016+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:02.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 systemd[1]: Stopping Ceph osd.7 for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:45:02.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:02.234+0000 7f65590c5700 -1 received signal: Terminated from /run/podman-init -- /usr/bin/ceph-osd -n osd.7 -f --setuser ceph --setgroup ceph --default-log-to-file=false --default-log-to-journald=true --default-log-to-stderr=false (PID: 1) UID: 0 2024-05-25T05:45:02.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:02.234+0000 7f65590c5700 -1 osd.7 128 *** Got signal Terminated *** 2024-05-25T05:45:02.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:02 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:02.234+0000 7f65590c5700 -1 osd.7 128 *** Immediate shutdown (osd_fast_shutdown=true) *** 2024-05-25T05:45:03.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.007+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:03.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.007+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:03.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.007+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:03.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.007+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:04.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.974+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:04.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.974+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:04.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.974+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:04.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:03 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:03.974+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:05.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:04.996+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:05.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:04.996+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:05.386 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:04.996+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:05.386 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:04 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:04.996+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:06.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:06.015+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:06.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:06.015+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:06.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:06.015+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:06.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:06 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:06.015+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:07.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:07 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:07.057+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6806 osd.0 since back 2024-05-25T05:44:09.276701+0000 front 2024-05-25T05:44:09.276839+0000 (oldest deadline 2024-05-25T05:44:34.576850+0000) 2024-05-25T05:45:07.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:07 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:07.057+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6814 osd.1 since back 2024-05-25T05:44:14.577377+0000 front 2024-05-25T05:44:14.577429+0000 (oldest deadline 2024-05-25T05:44:40.477324+0000) 2024-05-25T05:45:07.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:07 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:07.057+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6822 osd.2 since back 2024-05-25T05:44:25.678633+0000 front 2024-05-25T05:44:25.678577+0000 (oldest deadline 2024-05-25T05:44:50.378482+0000) 2024-05-25T05:45:07.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:07 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7[38985]: 2024-05-25T05:45:07.058+0000 7f6553a5c700 -1 osd.7 128 heartbeat_check: no reply from 172.21.15.88:6830 osd.3 since back 2024-05-25T05:44:31.479191+0000 front 2024-05-25T05:44:31.479202+0000 (oldest deadline 2024-05-25T05:44:56.779254+0000) 2024-05-25T05:45:08.051 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:07 smithi136 podman[134885]: 2024-05-25 05:45:07.788681388 +0000 UTC m=+5.651072461 container died 22b8b2698fda6a6bdecb4dee74ed4cdf9f19ac78a74a6f3dfe3013733adde8dd (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, maintainer=Guillaume Abrioux , build-date=2022-05-03T08:36:31.336870, io.buildah.version=1.19.8, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, version=8, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.k8s.display-name=CentOS Stream 8, vcs-type=git, io.openshift.tags=base centos centos-stream, name=centos-stream, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, com.redhat.component=centos-stream-container, distribution-scope=public, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, ceph=True, io.openshift.expose-services=, GIT_BRANCH=HEAD, release=754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, GIT_REPO=https://github.com/ceph/ceph-container.git, architecture=x86_64, vendor=Red Hat, Inc., GIT_CLEAN=True, RELEASE=HEAD, CEPH_POINT_RELEASE=-17.2.0) 2024-05-25T05:45:08.384 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 podman[134885]: 2024-05-25 05:45:08.225301073 +0000 UTC m=+6.087692135 container cleanup 22b8b2698fda6a6bdecb4dee74ed4cdf9f19ac78a74a6f3dfe3013733adde8dd (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7, GIT_BRANCH=HEAD, io.k8s.display-name=CentOS Stream 8, build-date=2022-05-03T08:36:31.336870, vcs-type=git, io.buildah.version=1.19.8, RELEASE=HEAD, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, release=754, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vendor=Red Hat, Inc., io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, distribution-scope=public, architecture=x86_64, version=8, GIT_CLEAN=True, com.redhat.component=centos-stream-container, ceph=True, CEPH_POINT_RELEASE=-17.2.0, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb) 2024-05-25T05:45:08.385 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 bash[134885]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7 2024-05-25T05:45:08.709 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 podman[135198]: 2024-05-25 05:45:08.426666808 +0000 UTC m=+0.642554202 container remove 22b8b2698fda6a6bdecb4dee74ed4cdf9f19ac78a74a6f3dfe3013733adde8dd (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7, GIT_REPO=https://github.com/ceph/ceph-container.git, RELEASE=HEAD, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, CEPH_POINT_RELEASE=-17.2.0, io.openshift.expose-services=, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, com.redhat.component=centos-stream-container, maintainer=Guillaume Abrioux , com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, vendor=Red Hat, Inc., build-date=2022-05-03T08:36:31.336870, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, distribution-scope=public, io.k8s.display-name=CentOS Stream 8, io.openshift.tags=base centos centos-stream, ceph=True, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, vcs-type=git, architecture=x86_64, GIT_BRANCH=HEAD, io.buildah.version=1.19.8, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, release=754, GIT_CLEAN=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly.) 2024-05-25T05:45:08.709 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 bash[135213]: Error: no container with name or ID "ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd.7" found: no such container 2024-05-25T05:45:09.004 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 podman[135292]: 2024-05-25 05:45:08.615073556 +0000 UTC m=+0.023448972 image pull e1d6a67b021eb077ee22bf650f1a9fb1980a2cf5c36bdb9cba9eac6de8f702d9 quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a 2024-05-25T05:45:09.005 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 podman[135292]: 2024-05-25 05:45:08.727950255 +0000 UTC m=+0.136325670 container create 9111bc1e08cd32e0617b73b531f0406035529e66b9093767e97f196e30d2f6f8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_CLEAN=True, version=8, RELEASE=HEAD, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, build-date=2022-05-03T08:36:31.336870, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, release=754, name=centos-stream, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, GIT_BRANCH=HEAD, ceph=True, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, vendor=Red Hat, Inc., architecture=x86_64, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., maintainer=Guillaume Abrioux , vcs-type=git, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.openshift.tags=base centos centos-stream, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0) 2024-05-25T05:45:09.005 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 podman[135292]: 2024-05-25 05:45:08.921984719 +0000 UTC m=+0.330360133 container init 9111bc1e08cd32e0617b73b531f0406035529e66b9093767e97f196e30d2f6f8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7-deactivate, vcs-type=git, build-date=2022-05-03T08:36:31.336870, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., io.buildah.version=1.19.8, architecture=x86_64, GIT_CLEAN=True, GIT_BRANCH=HEAD, release=754, name=centos-stream, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, maintainer=Guillaume Abrioux , GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, com.redhat.component=centos-stream-container, io.openshift.expose-services=, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.tags=base centos centos-stream, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, RELEASE=HEAD, ceph=True, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, version=8, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com) 2024-05-25T05:45:09.005 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:08 smithi136 podman[135292]: 2024-05-25 05:45:08.92564411 +0000 UTC m=+0.334019524 container start 9111bc1e08cd32e0617b73b531f0406035529e66b9093767e97f196e30d2f6f8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7-deactivate, io.openshift.expose-services=, com.redhat.component=centos-stream-container, CEPH_POINT_RELEASE=-17.2.0, ceph=True, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, distribution-scope=public, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, RELEASE=HEAD, release=754, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, version=8, io.openshift.tags=base centos centos-stream, name=centos-stream, io.k8s.display-name=CentOS Stream 8, io.buildah.version=1.19.8, vendor=Red Hat, Inc., vcs-type=git, GIT_BRANCH=HEAD, GIT_CLEAN=True, maintainer=Guillaume Abrioux , summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, build-date=2022-05-03T08:36:31.336870, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-05-25T05:45:09.005 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:09 smithi136 podman[135292]: 2024-05-25 05:45:09.005167713 +0000 UTC m=+0.413543127 container attach 9111bc1e08cd32e0617b73b531f0406035529e66b9093767e97f196e30d2f6f8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7-deactivate, GIT_BRANCH=HEAD, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, release=754, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac, io.openshift.tags=base centos centos-stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., architecture=x86_64, vcs-type=git, com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, GIT_CLEAN=True, io.buildah.version=1.19.8, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, io.openshift.expose-services=, ceph=True, vendor=Red Hat, Inc., com.redhat.component=centos-stream-container, build-date=2022-05-03T08:36:31.336870, CEPH_POINT_RELEASE=-17.2.0, version=8, maintainer=Guillaume Abrioux , distribution-scope=public, RELEASE=HEAD, GIT_REPO=https://github.com/ceph/ceph-container.git, io.k8s.display-name=CentOS Stream 8, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream) 2024-05-25T05:45:09.634 INFO:journalctl@ceph.osd.7.smithi136.stdout:May 25 05:45:09 smithi136 podman[135292]: 2024-05-25 05:45:09.452429527 +0000 UTC m=+0.860804941 container died 9111bc1e08cd32e0617b73b531f0406035529e66b9093767e97f196e30d2f6f8 (image=quay.io/ceph/ceph@sha256:12a0a4f43413fd97a14a3d47a3451b2d2df50020835bb93db666209f3f77617a, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-osd-7-deactivate, io.openshift.expose-services=, GIT_REPO=https://github.com/ceph/ceph-container.git, GIT_CLEAN=True, io.k8s.display-name=CentOS Stream 8, version=8, io.buildah.version=1.19.8, release=754, com.redhat.component=centos-stream-container, vcs-ref=f1ee6e37554363ec55e0035aba1a693d3627fdeb, CEPH_POINT_RELEASE=-17.2.0, maintainer=Guillaume Abrioux , io.openshift.tags=base centos centos-stream, vcs-type=git, com.redhat.license_terms=https://centos.org/legal/licensing-policy/, url=https://access.redhat.com/containers/#/registry.access.redhat.com/ubi8/images/8.6-754, name=centos-stream, vendor=Red Hat, Inc., com.redhat.build-host=cpt-1002.osbs.prod.upshift.rdu2.redhat.com, RELEASE=HEAD, ceph=True, GIT_BRANCH=HEAD, description=CentOS Stream is a continuously delivered distro that tracks just ahead of Red Hat Enterprise Linux development. This image takes the Red Hat UBI and layers on content from CentOS Stream, io.k8s.description=The Universal Base Image is designed and engineered to be the base layer for all of your containerized applications, middleware and utilities. This base image is freely redistributable, but Red Hat only supports Red Hat technologies through subscriptions for Red Hat products. This image is maintained by Red Hat and updated regularly., build-date=2022-05-03T08:36:31.336870, summary=Provides a CentOS Stream container based on the Red Hat Universal Base Image, architecture=x86_64, distribution-scope=public, GIT_COMMIT=b613db0f44179c0940781c1c7fe04e1acb7093ac) 2024-05-25T05:45:10.037 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@osd.7.service' 2024-05-25T05:45:10.116 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:45:10.117 INFO:tasks.cephadm.osd.7:Stopped osd.7 2024-05-25T05:45:10.117 INFO:tasks.cephadm.prometheus.a:Stopping prometheus.a... 2024-05-25T05:45:10.117 DEBUG:teuthology.orchestra.run.smithi136:> sudo systemctl stop ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a 2024-05-25T05:45:10.385 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:10 smithi136 systemd[1]: Stopping Ceph prometheus.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:45:12.155 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=main.go:840 level=warn msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:45:12.155 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=main.go:864 level=info msg="Stopping scrape discovery manager..." 2024-05-25T05:45:12.155 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=main.go:878 level=info msg="Stopping notify discovery manager..." 2024-05-25T05:45:12.155 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=manager.go:988 level=info component="rule manager" msg="Stopping rule manager..." 2024-05-25T05:45:12.156 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=main.go:874 level=info msg="Notify discovery manager stopped" 2024-05-25T05:45:12.156 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=main.go:860 level=info msg="Scrape discovery manager stopped" 2024-05-25T05:45:12.156 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=manager.go:998 level=info component="rule manager" msg="Rule manager stopped" 2024-05-25T05:45:12.156 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=main.go:915 level=info msg="Stopping scrape manager..." 2024-05-25T05:45:12.156 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.904Z caller=main.go:907 level=info msg="Scrape manager stopped" 2024-05-25T05:45:12.156 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.905Z caller=notifier.go:606 level=info component=notifier msg="Stopping notification manager..." 2024-05-25T05:45:12.156 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.905Z caller=main.go:1135 level=info msg="Notifier manager stopped" 2024-05-25T05:45:12.157 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a[94275]: ts=2024-05-25T05:45:11.905Z caller=main.go:1147 level=info msg="See you next time!" 2024-05-25T05:45:12.157 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:11 smithi136 podman[135608]: 2024-05-25 05:45:11.915046485 +0000 UTC m=+0.745487316 container died aea77ce696fab11623cd29bce809a4a532adca5f30046730bdff186a1ab63a7f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:12.471 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:12 smithi136 podman[135608]: 2024-05-25 05:45:12.254932175 +0000 UTC m=+1.085373047 container cleanup aea77ce696fab11623cd29bce809a4a532adca5f30046730bdff186a1ab63a7f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:12.472 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:12 smithi136 bash[135608]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a 2024-05-25T05:45:12.748 INFO:journalctl@ceph.prometheus.a.smithi136.stdout:May 25 05:45:12 smithi136 podman[135708]: 2024-05-25 05:45:12.472604054 +0000 UTC m=+0.559789573 container remove aea77ce696fab11623cd29bce809a4a532adca5f30046730bdff186a1ab63a7f (image=quay.io/prometheus/prometheus:v2.43.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-prometheus-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:13.323 DEBUG:teuthology.orchestra.run.smithi136:> sudo pkill -f 'journalctl -f -n 0 -u ceph-9a885618-1a54-11ef-bc9b-c7b262605968@prometheus.a.service' 2024-05-25T05:45:13.358 DEBUG:teuthology.orchestra.run:got remote process result: None 2024-05-25T05:45:13.358 INFO:tasks.cephadm.prometheus.a:Stopped prometheus.a 2024-05-25T05:45:13.359 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 --force --keep-logs 2024-05-25T05:45:15.250 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:14 smithi088 systemd[1]: Stopping Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:45:15.529 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:15 smithi088 podman[158895]: 2024-05-25 05:45:15.247243159 +0000 UTC m=+0.122931933 container died b882d57e2d6ee2ba4e1b7fb0b7c5ed09b4d9d7be43ee72bb1ec758bea2adf5a3 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:15.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:15 smithi088 podman[158895]: 2024-05-25 05:45:15.728463744 +0000 UTC m=+0.604152504 container cleanup b882d57e2d6ee2ba4e1b7fb0b7c5ed09b4d9d7be43ee72bb1ec758bea2adf5a3 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:15.807 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:15 smithi088 bash[158895]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a 2024-05-25T05:45:16.306 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:15 smithi088 podman[158908]: 2024-05-25 05:45:15.979862734 +0000 UTC m=+0.731706197 container remove b882d57e2d6ee2ba4e1b7fb0b7c5ed09b4d9d7be43ee72bb1ec758bea2adf5a3 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:16.307 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:15 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:45:16.307 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:16 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Failed with result 'exit-code'. 2024-05-25T05:45:16.307 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:16 smithi088 systemd[1]: Stopped Ceph node-exporter.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:45:16.307 INFO:journalctl@ceph.node-exporter.a.smithi088.stdout:May 25 05:45:16 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.a.service: Consumed 1.572s CPU time. 2024-05-25T05:45:16.583 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:16 smithi088 systemd[1]: Stopping Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:45:16.917 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:16 smithi088 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a[112539]: ts=2024-05-25T05:45:16.583Z caller=main.go:583 level=info msg="Received SIGTERM, exiting gracefully..." 2024-05-25T05:45:16.917 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:16 smithi088 podman[159017]: 2024-05-25 05:45:16.624228952 +0000 UTC m=+0.156127727 container died 5a72ab1af946e5af80dafa0ebe7377a1c64c9ebefea383087f825d23c9106972 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:17.306 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:17 smithi088 podman[159017]: 2024-05-25 05:45:17.108436425 +0000 UTC m=+0.640335196 container cleanup 5a72ab1af946e5af80dafa0ebe7377a1c64c9ebefea383087f825d23c9106972 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:17.307 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:17 smithi088 bash[159017]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a 2024-05-25T05:45:17.768 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:17 smithi088 podman[159030]: 2024-05-25 05:45:17.385187579 +0000 UTC m=+0.751211466 container remove 5a72ab1af946e5af80dafa0ebe7377a1c64c9ebefea383087f825d23c9106972 (image=quay.io/prometheus/alertmanager:v0.25.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-alertmanager-a, maintainer=The Prometheus Authors ) 2024-05-25T05:45:17.768 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:17 smithi088 podman[159030]: 2024-05-25 05:45:17.460960558 +0000 UTC m=+0.826984471 volume remove c00d1aa125a6555b685459c4c9e90e84d71c6b889d9ae0f2532a3b16a3d12651 2024-05-25T05:45:17.768 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:17 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Deactivated successfully. 2024-05-25T05:45:17.768 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:17 smithi088 systemd[1]: Stopped Ceph alertmanager.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:45:17.768 INFO:journalctl@ceph.alertmanager.a.smithi088.stdout:May 25 05:45:17 smithi088 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@alertmanager.a.service: Consumed 1.256s CPU time. 2024-05-25T05:45:40.593 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 --force --keep-logs 2024-05-25T05:45:43.384 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:43 smithi136 systemd[1]: Stopping Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:45:43.754 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:43 smithi136 podman[137020]: 2024-05-25 05:45:43.498465043 +0000 UTC m=+0.132531642 container died c86191bd770a3ec7c3be48219ea1834879e3af6240dc3d0c68797c591d68f043 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:45:44.129 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:43 smithi136 podman[137020]: 2024-05-25 05:45:43.845708544 +0000 UTC m=+0.479775142 container cleanup c86191bd770a3ec7c3be48219ea1834879e3af6240dc3d0c68797c591d68f043 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:45:44.129 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:43 smithi136 bash[137020]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b 2024-05-25T05:45:44.384 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:44 smithi136 podman[137035]: 2024-05-25 05:45:44.130196153 +0000 UTC m=+0.635809897 container remove c86191bd770a3ec7c3be48219ea1834879e3af6240dc3d0c68797c591d68f043 (image=quay.io/prometheus/node-exporter:v1.5.0, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-node-exporter-b, maintainer=The Prometheus Authors ) 2024-05-25T05:45:44.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:44 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Main process exited, code=exited, status=143/n/a 2024-05-25T05:45:44.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:44 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Failed with result 'exit-code'. 2024-05-25T05:45:44.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:44 smithi136 systemd[1]: Stopped Ceph node-exporter.b for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:45:44.385 INFO:journalctl@ceph.node-exporter.b.smithi136.stdout:May 25 05:45:44 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@node-exporter.b.service: Consumed 1.562s CPU time. 2024-05-25T05:45:44.701 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:44 smithi136 systemd[1]: Stopping Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968... 2024-05-25T05:45:44.702 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=server t=2024-05-25T05:45:44.692020714Z level=info msg="Shutdown started" reason="System signal: terminated" 2024-05-25T05:45:44.702 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=ticker t=2024-05-25T05:45:44.692439755Z level=info msg=stopped last_tick=2024-05-25T05:45:40Z 2024-05-25T05:45:44.702 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:44 smithi136 ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a[107771]: logger=tracing t=2024-05-25T05:45:44.692451136Z level=info msg="Closing tracing" 2024-05-25T05:45:44.975 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:44 smithi136 podman[137139]: 2024-05-25 05:45:44.702256967 +0000 UTC m=+0.116494006 container died 6a7a56a667d5b8a90f047417ad3920b4f3ec284b0cc555ad61299aec45bc3cb3 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:45:45.317 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:45 smithi136 podman[137139]: 2024-05-25 05:45:45.133522179 +0000 UTC m=+0.547759259 container cleanup 6a7a56a667d5b8a90f047417ad3920b4f3ec284b0cc555ad61299aec45bc3cb3 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:45:45.318 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:45 smithi136 bash[137139]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a 2024-05-25T05:45:45.634 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:45 smithi136 podman[137153]: 2024-05-25 05:45:45.318175762 +0000 UTC m=+0.617622454 container remove 6a7a56a667d5b8a90f047417ad3920b4f3ec284b0cc555ad61299aec45bc3cb3 (image=quay.io/ceph/grafana:9.4.12, name=ceph-9a885618-1a54-11ef-bc9b-c7b262605968-grafana-a, maintainer=Grafana Labs ) 2024-05-25T05:45:45.635 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:45 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Deactivated successfully. 2024-05-25T05:45:45.635 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:45 smithi136 systemd[1]: Stopped Ceph grafana.a for 9a885618-1a54-11ef-bc9b-c7b262605968. 2024-05-25T05:45:45.635 INFO:journalctl@ceph.grafana.a.smithi136.stdout:May 25 05:45:45 smithi136 systemd[1]: ceph-9a885618-1a54-11ef-bc9b-c7b262605968@grafana.a.service: Consumed 6.714s CPU time. 2024-05-25T05:45:57.105 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-25T05:45:57.138 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f /etc/ceph/ceph.conf /etc/ceph/ceph.client.admin.keyring 2024-05-25T05:45:57.168 INFO:tasks.cephadm:Archiving crash dumps... 2024-05-25T05:45:57.170 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291/remote/smithi088/crash 2024-05-25T05:45:57.171 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/crash -- . 2024-05-25T05:45:57.218 INFO:teuthology.orchestra.run.smithi088.stderr:tar: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-05-25T05:45:57.218 INFO:teuthology.orchestra.run.smithi088.stderr:tar: Error is not recoverable: exiting now 2024-05-25T05:45:57.220 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/crash to /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291/remote/smithi136/crash 2024-05-25T05:45:57.221 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/crash -- . 2024-05-25T05:45:57.265 INFO:teuthology.orchestra.run.smithi136.stderr:tar: /var/lib/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/crash: Cannot open: No such file or directory 2024-05-25T05:45:57.265 INFO:teuthology.orchestra.run.smithi136.stderr:tar: Error is not recoverable: exiting now 2024-05-25T05:45:57.266 INFO:tasks.cephadm:Checking cluster log for badness... 2024-05-25T05:45:57.266 DEBUG:teuthology.orchestra.run.smithi088:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.log | egrep CEPHADM_ | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | head -n 1 2024-05-25T05:45:57.295 INFO:teuthology.orchestra.run.smithi088.stdout:2024-05-25T05:10:07.178045+0000 mon.a (mon.0) 353 : cluster [WRN] Health check failed: 1 stray daemon(s) not managed by cephadm (CEPHADM_STRAY_DAEMON) 2024-05-25T05:45:57.296 WARNING:tasks.cephadm:Found errors (ERR|WRN|SEC) in cluster log 2024-05-25T05:45:57.296 INFO:tasks.cephadm:Compressing logs... 2024-05-25T05:45:57.296 DEBUG:teuthology.orchestra.run.smithi088:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-25T05:45:57.338 DEBUG:teuthology.orchestra.run.smithi136:> time sudo find /var/log/ceph /var/log/rbd-target-api -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-05-25T05:45:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.log 2024-05-25T05:45:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:: No such file or directory 2024-05-25T05:45:57.362 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.2.log 2024-05-25T05:45:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.audit.log 2024-05-25T05:45:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.log: /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.2.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.3.log 2024-05-25T05:45:57.363 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-client.rgw.foo.smithi088.beqodg.log 2024-05-25T05:45:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.1.log 2024-05-25T05:45:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-client.rgw.foo.smithi088.beqodg.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mgr.y.log 2024-05-25T05:45:57.365 INFO:teuthology.orchestra.run.smithi088.stderr: 62.3% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-client.rgw.foo.smithi088.beqodg.log.gz 2024-05-25T05:45:57.365 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.0.log 2024-05-25T05:45:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mgr.y.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.c.log 2024-05-25T05:45:57.366 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.0.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.a.log 2024-05-25T05:45:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:find: ‘/var/log/rbd-target-api’gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.log 2024-05-25T05:45:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:: No such file or directory 2024-05-25T05:45:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.audit.log 2024-05-25T05:45:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.7.log 2024-05-25T05:45:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.audit.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.5.log 2024-05-25T05:45:57.367 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.4.log 2024-05-25T05:45:57.369 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.7.log: gzip/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.5.log: -5 --verbose/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.4.log: 89.2% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.log.gz 2024-05-25T05:45:57.369 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.c.log: 94.0% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.log.gz 2024-05-25T05:45:57.370 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-05-25T05:45:57.384 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/tcmu-runner.log 2024-05-25T05:45:57.386 INFO:teuthology.orchestra.run.smithi136.stderr: 92.9% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-05-25T05:45:57.386 INFO:teuthology.orchestra.run.smithi136.stderr: -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mgr.x.log 2024-05-25T05:45:57.388 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-client.rgw.foo.smithi136.bfemvm.log 2024-05-25T05:45:57.388 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mgr.x.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.6.log 2024-05-25T05:45:57.388 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-client.rgw.foo.smithi136.bfemvm.log: 63.4% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-client.rgw.foo.smithi136.bfemvm.log.gz 2024-05-25T05:45:57.389 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.cephadm.log 2024-05-25T05:45:57.391 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.cephadm.log: 95.0% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-05-25T05:45:57.398 INFO:teuthology.orchestra.run.smithi088.stderr: 95.5% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.audit.log.gz 2024-05-25T05:45:57.402 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.6.log: gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-volume.log 2024-05-25T05:45:57.403 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-volume.log 2024-05-25T05:45:57.403 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/tcmu-runner.log: 88.0% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/tcmu-runner.log.gz 2024-05-25T05:45:57.406 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.cephadm.log: 91.7% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph.cephadm.log.gz 2024-05-25T05:45:57.407 INFO:teuthology.orchestra.run.smithi088.stderr:gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-25T05:45:57.413 INFO:teuthology.orchestra.run.smithi136.stderr:gzip -5 --verbose -- /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.b.log 2024-05-25T05:45:57.430 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-volume.log: gzip -5 --verbose -- /var/log/ceph/cephadm.log 2024-05-25T05:45:57.478 INFO:teuthology.orchestra.run.smithi088.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-volume.log: /var/log/ceph/cephadm.log: 92.3% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-05-25T05:45:57.480 INFO:teuthology.orchestra.run.smithi088.stderr: 91.0% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-25T05:45:57.505 INFO:teuthology.orchestra.run.smithi136.stderr:/var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.b.log: /var/log/ceph/cephadm.log: 90.7% -- replaced with /var/log/ceph/cephadm.log.gz 2024-05-25T05:45:57.550 INFO:teuthology.orchestra.run.smithi136.stderr: 92.4% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-volume.log.gz 2024-05-25T05:45:57.571 INFO:teuthology.orchestra.run.smithi136.stderr: 88.8% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mgr.x.log.gz 2024-05-25T05:45:58.111 INFO:teuthology.orchestra.run.smithi136.stderr: 92.7% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.b.log.gz 2024-05-25T05:45:58.276 INFO:teuthology.orchestra.run.smithi088.stderr: 92.9% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.c.log.gz 2024-05-25T05:45:58.368 INFO:teuthology.orchestra.run.smithi088.stderr: 93.1% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.2.log.gz 2024-05-25T05:45:58.660 INFO:teuthology.orchestra.run.smithi088.stderr: 88.5% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mgr.y.log.gz 2024-05-25T05:45:58.732 INFO:teuthology.orchestra.run.smithi136.stderr: 93.2% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.6.log.gz 2024-05-25T05:45:58.830 INFO:teuthology.orchestra.run.smithi136.stderr: 93.8% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.7.log.gz 2024-05-25T05:45:58.923 INFO:teuthology.orchestra.run.smithi136.stderr: 93.7% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.4.log.gz 2024-05-25T05:45:58.951 INFO:teuthology.orchestra.run.smithi136.stderr: 93.5% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.5.log.gz 2024-05-25T05:45:58.953 INFO:teuthology.orchestra.run.smithi136.stderr: 2024-05-25T05:45:58.954 INFO:teuthology.orchestra.run.smithi136.stderr:real 0m1.601s 2024-05-25T05:45:58.954 INFO:teuthology.orchestra.run.smithi136.stderr:user 0m6.523s 2024-05-25T05:45:58.954 INFO:teuthology.orchestra.run.smithi136.stderr:sys 0m0.305s 2024-05-25T05:45:58.991 INFO:teuthology.orchestra.run.smithi088.stderr: 93.6% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.1.log.gz 2024-05-25T05:45:59.023 INFO:teuthology.orchestra.run.smithi088.stderr: 93.5% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.0.log.gz 2024-05-25T05:45:59.349 INFO:teuthology.orchestra.run.smithi088.stderr: 93.6% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-osd.3.log.gz 2024-05-25T05:45:59.615 INFO:teuthology.orchestra.run.smithi088.stderr: 91.8% -- replaced with /var/log/ceph/9a885618-1a54-11ef-bc9b-c7b262605968/ceph-mon.a.log.gz 2024-05-25T05:45:59.617 INFO:teuthology.orchestra.run.smithi088.stderr: 2024-05-25T05:45:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:real 0m2.266s 2024-05-25T05:45:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:user 0m10.464s 2024-05-25T05:45:59.617 INFO:teuthology.orchestra.run.smithi088.stderr:sys 0m0.390s 2024-05-25T05:45:59.618 INFO:tasks.cephadm:Archiving logs... 2024-05-25T05:45:59.618 DEBUG:teuthology.misc:Transferring archived files from smithi088:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291/remote/smithi088/log 2024-05-25T05:45:59.619 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-25T05:46:01.012 DEBUG:teuthology.misc:Transferring archived files from smithi136:/var/log/ceph to /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291/remote/smithi136/log 2024-05-25T05:46:01.013 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /var/log/ceph -- . 2024-05-25T05:46:01.900 INFO:tasks.cephadm:Removing cluster... 2024-05-25T05:46:01.900 DEBUG:teuthology.orchestra.run.smithi088:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 --force 2024-05-25T05:46:02.187 DEBUG:teuthology.orchestra.run.smithi136:> sudo /home/ubuntu/cephtest/cephadm rm-cluster --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 --force 2024-05-25T05:46:02.481 INFO:tasks.cephadm:Removing cephadm ... 2024-05-25T05:46:02.482 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-25T05:46:02.498 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf /home/ubuntu/cephtest/cephadm 2024-05-25T05:46:02.513 INFO:tasks.cephadm:Teardown complete 2024-05-25T05:46:02.514 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-05-25T05:46:02.523 INFO:teuthology.task.clock:Checking final clock skew... 2024-05-25T05:46:02.523 DEBUG:teuthology.orchestra.run.smithi088:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-25T05:46:02.541 DEBUG:teuthology.orchestra.run.smithi136:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-05-25T05:46:02.552 INFO:teuthology.orchestra.run.smithi088.stderr:bash: line 1: ntpq: command not found 2024-05-25T05:46:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-25T05:46:02.556 INFO:teuthology.orchestra.run.smithi088.stdout:=============================================================================== 2024-05-25T05:46:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:^* hv01.front.sepia.ceph.com 3 6 377 15 +1020us[+1017us] +/- 54ms 2024-05-25T05:46:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv02.front.sepia.ceph.com 3 7 377 15 -484us[ -488us] +/- 50ms 2024-05-25T05:46:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:^+ hv03.front.sepia.ceph.com 3 7 377 14 -676us[ -676us] +/- 63ms 2024-05-25T05:46:02.557 INFO:teuthology.orchestra.run.smithi088.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:46:02.567 INFO:teuthology.orchestra.run.smithi136.stderr:bash: line 1: ntpq: command not found 2024-05-25T05:46:02.571 INFO:teuthology.orchestra.run.smithi136.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-05-25T05:46:02.572 INFO:teuthology.orchestra.run.smithi136.stdout:=============================================================================== 2024-05-25T05:46:02.572 INFO:teuthology.orchestra.run.smithi136.stdout:^* hv01.front.sepia.ceph.com 3 6 377 12 +1022us[+1029us] +/- 54ms 2024-05-25T05:46:02.572 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 13 -545us[ -538us] +/- 50ms 2024-05-25T05:46:02.572 INFO:teuthology.orchestra.run.smithi136.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 13 -715us[ -708us] +/- 63ms 2024-05-25T05:46:02.572 INFO:teuthology.orchestra.run.smithi136.stdout:^? hv04.front.sepia.ceph.com 0 9 0 - +0ns[ +0ns] +/- 0ns 2024-05-25T05:46:02.572 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-05-25T05:46:02.581 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-05-25T05:46:02.581 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-05-25T05:46:02.589 DEBUG:teuthology.orchestra.run.smithi088:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-25T05:46:02.701 DEBUG:teuthology.orchestra.run.smithi136:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-05-25T05:46:02.795 DEBUG:teuthology.orchestra.run.smithi088:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-25T05:46:02.825 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T05:46:02.825 DEBUG:teuthology.orchestra.run.smithi136:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 2024-05-25T05:46:02.854 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T05:46:02.855 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-05-25T05:46:02.864 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-05-25T05:46:02.883 INFO:teuthology.task.internal:Duration was 2619.325467 seconds 2024-05-25T05:46:02.884 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-05-25T05:46:02.892 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-05-25T05:46:02.892 DEBUG:teuthology.orchestra.run.smithi088:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-25T05:46:02.894 DEBUG:teuthology.orchestra.run.smithi136:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-05-25T05:46:02.930 INFO:teuthology.orchestra.run.smithi088.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-25T05:46:02.936 INFO:teuthology.orchestra.run.smithi136.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-05-25T05:46:03.340 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-05-25T05:46:03.340 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi088.front.sepia.ceph.com 2024-05-25T05:46:03.340 DEBUG:teuthology.orchestra.run.smithi088:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-25T05:46:03.401 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi136.front.sepia.ceph.com 2024-05-25T05:46:03.401 DEBUG:teuthology.orchestra.run.smithi136:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-05-25T05:46:03.427 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-05-25T05:46:03.427 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-25T05:46:03.444 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-05-25T05:46:03.493 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-05-25T05:46:03.493 DEBUG:teuthology.orchestra.run.smithi088:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-25T05:46:03.508 DEBUG:teuthology.orchestra.run.smithi136:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-05-25T05:46:04.309 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-05-25T05:46:04.318 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-05-25T05:46:04.318 DEBUG:teuthology.orchestra.run.smithi088:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-25T05:46:04.343 DEBUG:teuthology.orchestra.run.smithi136:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-05-25T05:46:04.367 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-05-25T05:46:04.377 DEBUG:teuthology.orchestra.run.smithi088:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-25T05:46:04.385 DEBUG:teuthology.orchestra.run.smithi136:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-05-25T05:46:04.406 INFO:teuthology.orchestra.run.smithi088.stdout:kernel.core_pattern = core 2024-05-25T05:46:04.431 INFO:teuthology.orchestra.run.smithi136.stdout:kernel.core_pattern = core 2024-05-25T05:46:04.466 DEBUG:teuthology.orchestra.run.smithi088:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-25T05:46:04.498 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T05:46:04.498 DEBUG:teuthology.orchestra.run.smithi136:> test -e /home/ubuntu/cephtest/archive/coredump 2024-05-25T05:46:04.520 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-05-25T05:46:04.521 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-05-25T05:46:04.531 INFO:teuthology.task.internal:Transferring archived files... 2024-05-25T05:46:04.532 DEBUG:teuthology.misc:Transferring archived files from smithi088:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291/remote/smithi088 2024-05-25T05:46:04.532 DEBUG:teuthology.orchestra.run.smithi088:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-25T05:46:04.597 DEBUG:teuthology.misc:Transferring archived files from smithi136:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/teuthology-2024-05-24_21:08:02-orch-squid-distro-default-smithi/7725291/remote/smithi136 2024-05-25T05:46:04.598 DEBUG:teuthology.orchestra.run.smithi136:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-05-25T05:46:04.645 INFO:teuthology.task.internal:Removing archive directory... 2024-05-25T05:46:04.646 DEBUG:teuthology.orchestra.run.smithi088:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-25T05:46:04.648 DEBUG:teuthology.orchestra.run.smithi136:> rm -rf -- /home/ubuntu/cephtest/archive 2024-05-25T05:46:04.689 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-05-25T05:46:04.700 INFO:teuthology.task.internal:Not uploading archives. 2024-05-25T05:46:04.700 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-05-25T05:46:04.709 INFO:teuthology.task.internal:Tidying up after the test... 2024-05-25T05:46:04.709 DEBUG:teuthology.orchestra.run.smithi088:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-25T05:46:04.711 DEBUG:teuthology.orchestra.run.smithi136:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-05-25T05:46:04.724 INFO:teuthology.orchestra.run.smithi088.stdout: 265296 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 25 05:46 /home/ubuntu/cephtest 2024-05-25T05:46:04.744 INFO:teuthology.orchestra.run.smithi136.stdout: 262165 4 drwxr-xr-x 2 ubuntu ubuntu 4096 May 25 05:46 /home/ubuntu/cephtest 2024-05-25T05:46:04.745 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-05-25T05:46:04.755 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-05-25T05:46:04.778 INFO:teuthology.run:Summary data: description: orch/cephadm/upgrade/{1-start-distro/1-start-centos_9.stream 2-repo_digest/defaut 3-upgrade/staggered 4-wait 5-upgrade-ls agent/on mon_election/connectivity} duration: 2619.32546710968 failure_reason: 'Command failed on smithi088 with status 1: ''sudo /home/ubuntu/cephtest/cephadm --image quay.io/ceph/ceph:v17.2.0 shell -c /etc/ceph/ceph.conf -k /etc/ceph/ceph.client.admin.keyring --fsid 9a885618-1a54-11ef-bc9b-c7b262605968 -e sha1=ea0684c08cbcf83f4af9930de2267b3563ac5f78 -- bash -c \''ceph orch upgrade check quay.ceph.io/ceph-ci/ceph:$sha1 | jq -e \''"\''"\''.up_to_date | length == 7\''"\''"\''\''''' owner: scheduled_teuthology@teuthology sentry_event: https://sentry.ceph.com/organizations/ceph/?query=5b8124d3e25d4c248ec324ee00f1aa3f status: fail success: false 2024-05-25T05:46:04.778 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-05-25T05:46:04.858 INFO:teuthology.run:FAIL